OpenDataLab

All

38 repositories

MinerU
Public
A high-quality tool for convert PDF to Markdown and JSON.一站式开源高质量数据提取工具，将PDF转换成Markdown和JSON格式。
python pdf parser ocr pdf-converter extract-data document-analysis pdf-parser layout-analysis ai4science
Python
•
GNU Affero General Public License v3.0
•1.9k•25k•42•4•Updated Jan 24, 2025Jan 24, 2025
labelU
Public
Data annotation toolbox supports image, audio and video data.
Python
•
Apache License 2.0
•97•973•13•0•Updated Jan 22, 2025Jan 22, 2025
labelU-Kit
Public
Data annotation component library --provided as NPM packages
TypeScript
•
Apache License 2.0
•18•72•2•2•Updated Jan 22, 2025Jan 22, 2025
LabelLLM
Public
The Open-Source Data Annotation Platform
TypeScript
•
Apache License 2.0
•53•640•10•0•Updated Jan 17, 2025Jan 17, 2025
OmniDocBench
Public
A Comprehensive Benchmark for Document Parsing and Evaluation
Python
•
Apache License 2.0
•20•209•7•0•Updated Jan 17, 2025Jan 17, 2025
DocLayout-YOLO
Public
DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception
Python
•
GNU Affero General Public License v3.0
•58•792•6•1•Updated Jan 16, 2025Jan 16, 2025
WanJuan3.0
Public
WanJuan3.0（“万卷·丝路”）一个作为综合性的纯文本语料库，采集了多个国家地区的网络公开信息、文献、专利等资料，数据总规模超1.2TB，Token总数超过300B，处于国际领先水平，首期开源的语料库主要由泰语、俄语、阿拉伯语、韩语和越南语5个子集构成，每个子集的数据规模均超过150GB
MIT License
•0•9•0•0•Updated Jan 10, 2025Jan 10, 2025
VHM
Public
VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis
Python
•
Apache License 2.0
•5•73•0•1•Updated Jan 8, 2025Jan 8, 2025
UrBench
Public
[AAAI 2025]This repo contains evaluation code for the paper “UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarios”
benchmark remote-sensing llama lmms vlm urban llava
Python
•
Other
•1•9•0•0•Updated Jan 7, 2025Jan 7, 2025
PDF-Extract-Kit
Public
A Comprehensive Toolkit for High-Quality PDF Content Extraction
Python
•
GNU Affero General Public License v3.0
•432•6.5k•73•4•Updated Jan 3, 2025Jan 3, 2025
CRaFT
Public
[AAAI25] Certainty Represented Knowledge Flow for Refusal-Aware Instruction Tuning
Python
•0•2•0•0•Updated Jan 1, 2025Jan 1, 2025
UniMERNet
Public
UniMERNet: A Universal Network for Real-World Mathematical Expression Recognition
Python
•
Apache License 2.0
•24•262•12•0•Updated Dec 26, 2024Dec 26, 2024
OHR-Bench
Public
OCR Hinders RAG: Evaluating the Cascading Impact of OCR on Retrieval-Augmented Generation
Python
•11•58•0•0•Updated Dec 19, 2024Dec 19, 2024
skydiffusion
Public
The official implementation of the paper “Street-to-Satellite Image Synthesis with Diffusion Models and BEV Paradigm”
Python
•
Apache License 2.0
•2•42•2•0•Updated Dec 14, 2024Dec 14, 2024
Miner-PDF-Benchmark
Public archive
MPB (Miner-PDF-Benchmark) is an end-to-end PDF document comprehension evaluation suite designed for large-scale model data scenarios.
Python
•
Apache License 2.0
•5•20•0•0•Updated Dec 11, 2024Dec 11, 2024
LOKI
Public
[ICLR 2025] The official implementation of the paper “LOKI：A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models”
Python
•1•125•1•0•Updated Nov 24, 2024Nov 24, 2024
magic-html
Public
Python
•
Apache License 2.0
•31•362•7•0•Updated Nov 22, 2024Nov 22, 2024
.github
Public
2•0•0•0•Updated Sep 12, 2024Sep 12, 2024
CLIP-Parrot-Bias
Public
ECCV2024_Parrot Captions Teach CLIP to Spot Text
Python
•
Apache License 2.0
•2•63•3•0•Updated Sep 6, 2024Sep 6, 2024
CrossViewDiff
Public
The official implementation of the paper "CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesis"
JavaScript
•1•13•1•0•Updated Sep 2, 2024Sep 2, 2024
MLS-BRN
Public
[CVPR 2024] 3D Building Reconstruction from Monocular Remote Sensing Images with Multi-level Supervisions
Python
•2•56•6•0•Updated Aug 30, 2024Aug 30, 2024
opendatalab-datasets
Public
datasets resource
10•100•3•0•Updated Aug 9, 2024Aug 9, 2024
CHARM
Public
[ACL 2024 Main Conference] Chinese commonsense benchmark for LLMs
Python
•
Apache License 2.0
•2•29•0•0•Updated Jul 27, 2024Jul 27, 2024
magic-doc
Public
Python
•
Apache License 2.0
•35•418•22•0•Updated Jul 26, 2024Jul 26, 2024
dsdl-sdk
Public
Jupyter Notebook
•
Apache License 2.0
•6•13•0•0•Updated May 29, 2024May 29, 2024
dsdl-docs
Public
Data Set Description Language Specification （新一代人工智能数据集描述语言DSDL）
HTML
•
Apache License 2.0
•6•47•1•0•Updated May 29, 2024May 29, 2024
MLLM-DataEngine
Public
MLLM-DataEngine: An Iterative Refinement Approach for MLLM
Python
•
Apache License 2.0
•5•42•0•0•Updated May 24, 2024May 24, 2024
image-downloader
Public
Python
•
Apache License 2.0
•3•26•2•0•Updated May 13, 2024May 13, 2024
WanJuan2.0-WanJuan-CC
Public
WanJuan-CC是以CommonCrawl为基础，经过数据抽取，规则清洗，去重，安全过滤，质量清洗等步骤得到的高质量数据。
0•13•1•0•Updated Apr 18, 2024Apr 18, 2024
VIGC
Public
AAAI 2024: Visual Instruction Generation and Correction
Python
•
Apache License 2.0
•3•91•3•0•Updated Feb 4, 2024Feb 4, 2024