Slopless

repository·main·Indexed 43 days ago

https://github.com/seochecks-ai/slopless

A deterministic linter, zero-config CLI, and textlint preset designed to detect and flag 'AI-slop'—hollow, repetitive, and vacuous prose produced by LLMs—in English Markdown. Version 0.2.38 includes datasets for LLM clichés and 'tortured phrases' from Humanities and Social Sciences (HSS) domains.

Tokens
40.9K
Snippets
98
Records
175
Agent score
53%

What's inside Slopless

  1. What is proselint

    main
    proselint is a linter for English prose. Similar to a spell checker, it scans files to detect stylistic issues and provides suggestions for improving prose based on advice from renowned writers and editors (such as George Orwell, Mark Twain, and Strunk & White). It is designed as a command-line utility that can be integrated into various tools, scripts, and workflows.
  2. Understand the Humanities and Social Sciences (HSS) Tortured Phrases dataset

    main

    This dataset provides fingerprints of 'tortured phrases' and 'tortured abbreviations' specifically within the Humanities and Social Sciences (HSS) domains, such as education, psychology, and economics.

    'Tortured phrases' are artifacts created by AI spinners (like QuillBot) that replace established scientific terms with nonsensical synonyms (e.g., 'bosom peril' instead of 'breast cancer'). This dataset extends existing STEM-focused databases to include HSS-specific examples like 'bound-together domain' instead of 'United Kingdom'.

  3. Access the Humanities and Social Sciences Tortured Phrases Dataset

    main

    The 'Tortured Phrases from the Humanities and Social Sciences' is a fingerprints dataset available via Zenodo. It is used for identifying academic 'slop' or non-standard phrasing in research papers.

    Dataset Metadata:

    • DOI: 10.5281/zenodo.14753785
    • Resource Type: Dataset
    • License: Creative Commons Attribution 4.0 International (CC BY 4.0)
    • Publisher: Zenodo
    https://doi.org/10.5281/zenodo.14753785
  4. Understand the Google style guide repository structure

    main

    The Google style guide implementation is organized into three main directories:

    • /Google: Contains the YAML-based rule implementations that define the style.
    • /fixtures: Contains individual unit tests. Each directory is named after a specific rule from /Google and contains its own .vale.ini file to isolate that rule.
    • /features: Contains Cucumber Step Definitions used for testing fixtures via the Aruba framework, which validates Vale's output against the fixture directories.
  5. Explore the llm-cliches dataset

    main

    The llm-cliches dataset is a collection of commonly used clichés and phrases found in Large Language Model (LLM) outputs. It is organized into three text files categorized by part of speech, which can be used to identify or filter AI-generated 'slop' in text:

    • adjectives.txt: Words that describe or modify nouns.
    • nouns.txt: Words that identify people, places, things, or ideas.
    • verbs.txt: Action words that describe what something or someone does.
  6. What is retrieval readiness in AI search?

    main

    In AI search, retrieval readiness is the ability of a page to survive the technical processes of chunking, embedding, passage selection, and answer compression.

    To achieve retrieval readiness, content must move beyond broad relevance and focus on being a high-quality 'retrieval candidate'. This means:

    • Avoiding Vague Content: Instead of phrases like "streamline your workflow," state exactly what the product does.
    • Passage-Level Stability: Individual sections (passages) must be extractable, specific, and stable even when separated from the parent page.
    • Evidence Density: Pages should contain concrete facts, definitions, criteria, examples, constraints, steps, tradeoffs, metrics, and named use cases rather than just category language and confident phrasing.
  7. How the solution-boring-frame rule matches text

    main

    The solution-boring-frame rule identifies instances where a solution-like subject is described as 'boring'. The matcher looks for a specific syntactic structure:

    1. A determiner: the, this, or that.
    2. A solution qualifier followed by a solution noun (newly supported nouns include principle, recommendation, rule, and technique).
    3. A scope phrase: one to six words beginning with a declared preposition or that.
    4. A linking verb followed by the word boring.

    Example structure: [the/this/that] [qualifier] [noun] [1-6 scope words] [linking verb] boring.

  8. Structure of the Fresh Slop Corpus Expansion

    main

    The Fresh Slop Corpus Expansion is organized into the following directories:

    • texts/: Contains long, realistic prose samples representing various slop-heavy writing styles.
    • edge-cases/hits/: Contains compact examples that are intended to be positive hits (slop) and should be reviewed for promotion to future fixture material.
    • edge-cases/no-hits/: Contains compact adversarial controls (clean text) that should remain unflagged after review.
    • analysis/: Contains first-pass notes regarding potential rule widenings and associated risks.
  9. Use Low-Rigor Candidate Generators for hypothesis generation

    main

    Low-Rigor Candidate Generators are external sources used to generate hypotheses for new slop detection rules. They should not be used for direct rule adoption. Instead, use them to identify candidate word families, sentence formulas, or tone patterns that can then be validated against more rigorous sources.

    Recommended Slopless workflows:

    • Derive density-gated tests: Use identified patterns to create rules that trigger based on the frequency of specific terms.
    • Create no-hit fixtures: Use these patterns to build test cases that ensure the engine correctly identifies (or ignores) specific slop styles.
    • Cross-check: Always validate terms found in these sources against rigorous datasets before promoting them to the core rule set.
  10. Understand the Subject-Action Cadence rule

    main

    The flat-action-cadence rule detects repetitive sentence structures in narrative prose. Specifically, it identifies when a paragraph contains four qualifying sentences within five consecutive sentences, where at least three sentences contain an action with a complement.

    Key Characteristics:

    • Tense Support: The rule recognizes past-tense subject-first narration using grammar tags and verb inflections (via the compromise library).
    • Exclusions: The rule ignores sentences that introduce time, conditions, or explanations. It also ignores quantities following a verb, additional clauses, and constructions using colons, semicolons, or dashes.
    • Limitations:
      • It detects structural repetition, not whether the content is stylistically appropriate (e.g., it may flag legitimate connected accounts or legal/biographical text).
      • It does not provide equal coverage for present-tense narration; present-tense detection relies on a separate, existing matcher.
      • It is subject to the accuracy of the underlying grammar tagger (e.g., misidentifying adjectives as verbs).
  11. Use standardized document types and templates

    main

    The workflow recommends using a small, consistent set of document types, each supported by a lightweight template. Using specific types allows for better routing of reviews (e.g., a runbook goes to operational review, while a decision record goes to ownership review).

    Recommended Document Types:

    • Decision record: Explains the choice, context, options considered, and the reason for the selected path.
    • Runbook: Explains how to identify a condition, steps to take, how to verify results, and when to escalate.
    • Reference page: Defines stable information like names, fields, interfaces, owners, or constraints.
    • Process guide: Explains recurring work in sequence.
    • Project brief: Explains scope, goals, dependencies, and status.
    • Review checklist: Defines the standard used during review.
  12. Understand Slopless candidate rule types and usage constraints

    main

    Slopless identifies several categories of 'Noisy or Source-Only Candidates'. These are linguistic patterns that are useful for expansion but should not be enabled as default global rules due to high false-positive risks.

    When implementing or configuring these rules, follow these usage principles:

    1. Avoid Single-Token Flagging: For categories like 'Broad AI Vocabulary' or 'Weak Words', do not flag individual words by default. Instead, use density-based rules (flagging when a word appears X times in a span) or stacking rules (flagging when multiple weak words appear together).
    2. Use Profile-Level Opt-in: These rules are best suited for specific profiles (e.g., an organization-specific style guide) rather than global prose linting.
    3. Contextual Awareness: High-signal detection occurs when these words are combined with other patterns, such as generic claims, lack of numerical data, or formal transition openers.
    4. Warning vs. Error: For patterns like 'Passive Voice', it is recommended to use a warning-only level rather than a hard error, as many technical or scientific contexts require passive constructions.