Add auto-reload, evaluation endpoint, show docs
This commit is contained in:
parent
eb7ddf1496
commit
22696c7f6f
34 changed files with 389 additions and 100 deletions
50
great_ai/src/sus.egg-info/PKG-INFO
Normal file
50
great_ai/src/sus.egg-info/PKG-INFO
Normal file
|
|
@ -0,0 +1,50 @@
|
|||
Metadata-Version: 2.1
|
||||
Name: sus
|
||||
Version: 0.0.3
|
||||
Summary: [S]coutinScience [u]tilitie[s]: reusable utilities for text processing
|
||||
Home-page: https://github.com/ScoutinScience/platform
|
||||
Author: ScoutinScience B.V.
|
||||
Author-email: andras@scoutinscience.com
|
||||
License: UNKNOWN
|
||||
Project-URL: Bug Tracker, https://github.com/ScoutinScience/platform/issues
|
||||
Platform: UNKNOWN
|
||||
Classifier: Programming Language :: Python :: 3
|
||||
Classifier: Operating System :: OS Independent
|
||||
Requires-Python: >=3.8
|
||||
Description-Content-Type: text/markdown
|
||||
|
||||
# **S**coutinScience **U**tilitie**S** for text processing [](https://github.com/ScoutinScience/platform/actions/workflows/sus-general.yaml)
|
||||
|
||||
> amogus
|
||||
|
||||
## Exports
|
||||
|
||||
- [clean](src/sus/clean.py)
|
||||
- [unique](src/sus/unique.py)
|
||||
- [parallel_map](src/sus/parallel_map.py)
|
||||
- [match_names](src/sus/match_names/match_names.py)
|
||||
- [evaluate_ranking](src/sus/evaluate_ranking/evaluate_ranking.py)
|
||||
|
||||
### Requires loading spacy model
|
||||
|
||||
> This is automatic but will require some time.
|
||||
|
||||
> Add this to the Dockerfile for caching the spaCy model:
|
||||
>
|
||||
> ```docker
|
||||
> RUN pip install --no-cache-dir en-core-web-lg@https://github.com/explosion/spacy-models/releases/download/en_core_web_lg-3.2.0/en_core_web_lg-3.2.0-py3-none-any.whl
|
||||
> ```
|
||||
|
||||
- [spacy model (nlp)](src/sus/nlp.py)
|
||||
- [get_sentences](src/sus/get_sentences.py)
|
||||
- [lemmatize_text](src/sus/lemmatize_text.py)
|
||||
- [lemmatize_token](src/sus/lemmatize_token.py)
|
||||
- [publication TEI](src/sus/publication_tei/publication_tei.py)
|
||||
|
||||
## Development
|
||||
|
||||
- Optional booleans must have a default value of `False`.
|
||||
- No imports in top-level `__init__.py`, in order to not load anything unnecessary automatically
|
||||
- Should only be updated through a PR
|
||||
|
||||
|
||||
Loading…
Add table
Add a link
Reference in a new issue