Metadata-Version: 2.4
Name: automate_supervised_dataset_generation
Version: 2.0.0
Summary: A brief description
Home-page: https://github.com/prakHr/automate-supervised-dataset-generation
Author: Prakhar Gandhi
Author-email: gprakhar0@gmail.com
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: mpire
Requires-Dist: playwright
Requires-Dist: transformers
Requires-Dist: torch
Requires-Dist: torchvision
Requires-Dist: hyperopt==0.2.5
Requires-Dist: hpsklearn==0.1.0
Requires-Dist: numpy==1.23
Requires-Dist: languagemodels
Dynamic: author
Dynamic: author-email
Dynamic: classifier
Dynamic: description
Dynamic: description-content-type
Dynamic: home-page
Dynamic: license-file
Dynamic: requires-dist
Dynamic: requires-python
Dynamic: summary

# automate-supervised-dataset-generation
-----

## Table of Contents

- [Installation](#installation)
- [License](#license)

## Installation

```console
pip install automate-supervised-dataset-generation
```

## Start the app
```
import automate_supervised_dataset_generation.automate
query = "Artificial Intelligence"
num_page = 2
labels = ["Not AI related","AI"]
# inference_size = "2gb" # for smaller inference time with mediocre tagging accuracy
inference_size = "8gb" # for larger inference time with best tagging accuracy
rv = automate_supervised_dataset_generation.automate.parallel_scraping(query,num_page,labels,inference_size=inference_size)
    
```

## License

`automate-supervised-dataset-generation` is distributed under the terms of the [MIT](https://spdx.org/licenses/MIT.html) license.
