Deduplicate
DevelopmentdeduplicateDeduplicate is an Agent Skill for development published in the semantica-agi/semantica repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.
Detect duplicate entities, duplicate groups, and relationship duplicates in Semantica using fuzzy matching, schema heuristics, and graph similarity.
How to use this skill
Bring this guide into your coding agent with a prompt tailored to the tool you use.
- Open your project in Codex.
- Copy and paste the prompt below.
- Review files and risks before approving any action.
Inspect the Agent Skill at https://github.com/semantica-agi/semantica/blob/HEAD/plugins/skills/deduplicate/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/deduplicate, but wait for my approval before writing files or running scripts.
Copying this prompt does not install or run the skill. Review third-party files before use.
/semantica:deduplicate
Remove duplicates from the knowledge graph. Usage: /semantica:deduplicate <strategy> [args]
$ARGUMENTS = deduplication strategy + optional entity or threshold.
entities [--threshold <score>] [--field <name>]
Detect duplicate entities and group them by similarity.
from semantica.deduplication import DuplicateDetector
finder = DuplicateDetector()
candidates = finder.detect_duplicates(entities, threshold=threshold)
groups = finder.detect_duplicate_groups(entities, threshold=threshold)
Output: duplicate candidate list, duplicate groups, and representative merge recommendations.
relations [--similarity <score>]
Detect duplicate relationships and normalize edge representations.
from semantica.deduplication import DuplicateDetector
finder = DuplicateDetector()
relations = finder.detect_duplicates(relation_list, threshold=similarity)
Result: duplicate relation candidates, normalized relationship groups, and cleanup summary.