forked from PaddlePaddle/PaddleOCR
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
31399ea
commit 03f6ca7
Showing
3 changed files
with
62 additions
and
5 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,55 @@ | ||
## Layout Analysis Dataset | ||
|
||
Here are the common datasets of layout anlysis, which are being updated continuously. Welcome to contribute datasets. | ||
|
||
- [PubLayNet dataset](#publaynet) | ||
- [CDLA dataset](#CDLA) | ||
- [TableBank dataset](#TableBank) | ||
|
||
|
||
Most of the layout analysis datasets are object detection datasets. In addition to open source datasets, you can also label or synthesize datasets using tools such as [labelme](https://github.com/wkentaro/labelme) and so on. | ||
|
||
|
||
<a name="publaynet"></a> | ||
|
||
#### 1. PubLayNet dataset | ||
|
||
- **Data source**: https://github.com/ibm-aur-nlp/PubLayNet | ||
- **Data introduction**: The PubLayNet dataset contains 350000 training images and 11000 validation images. There are 5 categories in total, namely: `text, title, list, table, figure`. Some images and their annotations as shown below. | ||
|
||
<div align="center"> | ||
<img src="../../datasets/publaynet_demo/gt_PMC3724501_00006.jpg" width="500"> | ||
<img src="../../datasets/publaynet_demo/gt_PMC5086060_00002.jpg" width="500"> | ||
</div> | ||
|
||
- **Download address**: https://developer.ibm.com/exchanges/data/all/publaynet/ | ||
- **Note**: When using this dataset, you need to follow [CDLA-Permissive](https://cdla.io/permissive-1-0/) license. | ||
|
||
|
||
<a name="CDLA"></a> | ||
|
||
#### 2、CDLA数据集 | ||
- **Data source**: https://github.com/buptlihang/CDLA | ||
- **Data introduction**: CDLA dataset contains 5000 training images and 1000 validation images with 10 categories, which are `Text, Title, Figure, Figure caption, Table, Table caption, Header, Footer, Reference, Equation`. Some images and their annotations as shown below. | ||
|
||
<div align="center"> | ||
<img src="../../datasets/CDLA_demo/val_0633.jpg" width="500"> | ||
<img src="../../datasets/CDLA_demo/val_0941.jpg" width="500"> | ||
</div> | ||
|
||
- **Download address**: https://github.com/buptlihang/CDLA | ||
- **Note**: When you train detection model on CDLA dataset using [PaddleDetection](https://github.com/PaddlePaddle/PaddleDetection/tree/develop), you need to remove the label `__ignore__` and `_background_`. | ||
|
||
<a name="TableBank"></a> | ||
|
||
#### 3、TableBank dataet | ||
- **Data source**: https://doc-analysis.github.io/tablebank-page/index.html | ||
- **Data introduction**: TableBank dataset contains 2 types of document: Latex (187199 training images, 7265 validation images and 5719 testing images) and Word (73383 training images 2735 validation images and 2281 testing images). Some images and their annotations as shown below. | ||
|
||
<div align="center"> | ||
<img src="../../datasets/tablebank_demo/004.png" height="700"> | ||
<img src="../../datasets/tablebank_demo/005.png" height="700"> | ||
</div> | ||
|
||
- **Data source**: https://doc-analysis.github.io/tablebank-page/index.html | ||
- **Note**: When using this dataset, you need to follow [Apache-2.0](https://github.com/doc-analysis/TableBank/blob/master/LICENSE) license. |