.. _processors:

=====================
Processors
=====================


Data Processors
---------------

Text
~~~~
.. autosummary::
    :toctree: generated/

    xpark.dataset.TextFuzzyDedup
    xpark.dataset.TextExactSubstringDedup
    xpark.dataset.TextChunking
    xpark.dataset.TextFlaggedWordRatio


Audio
~~~~~
.. autosummary::
    :toctree: generated/

    xpark.dataset.AudioCompute


Image
~~~~~
.. autosummary::
    :toctree: generated/

    xpark.dataset.ImageCompute


Video
~~~~~
.. autosummary::
    :toctree: generated/

    xpark.dataset.VideoCompute


AI Processors
-------------

Text
~~~~
.. autosummary::
    :toctree: generated/

    xpark.dataset.TextEmbedding
    xpark.dataset.TextSummarize
    xpark.dataset.TextMask
    xpark.dataset.TextGenerate
    xpark.dataset.TextClassify
    xpark.dataset.TextFixGrammar
    xpark.dataset.TextSimilarity
    xpark.dataset.TextTranslate
    xpark.dataset.TextSentiment
    xpark.dataset.TextExtract
    xpark.dataset.TextPredicateEval
    xpark.dataset.TextPerplexity
    xpark.dataset.TextLanguageDetector
    xpark.dataset.TextLanguageScore

Image
~~~~~
.. autosummary::
    :toctree: generated/

    xpark.dataset.ImageNSFWScore
    xpark.dataset.ImageTextSimilarityScore
    xpark.dataset.ImageAestheticScore


Audio
~~~~~
.. autosummary::
    :toctree: generated/

    xpark.dataset.SpeechToText