🚀 Getting Started
1. Paste your text in the Input panel or drag & drop a file (.txt, .md, .csv)
2. Configure your deduplication options in the left sidebar
3. The output updates automatically (or click Process if real-time is off)
⚙️ Matching Options
Case Sensitive When ON, "Apple" and "apple" are different. When OFF, they are treated as duplicates.
Trim Whitespace Removes leading/trailing spaces before comparing lines.
Normalize Spaces Converts multiple consecutive spaces to a single space.
🔄 Duplicates Handling
Keep First/Last Choose whether to keep the first or last occurrence of duplicate lines.
Move Duplicates Shows removed duplicates in a separate panel with occurrence counts.
Remove Empty Lines Automatically removes blank lines from the output.
🧠 Smart Features
Fuzzy Matching Detects similar lines (e.g., "color" vs "colour") using similarity threshold.
Regex Filter Only process lines matching a regular expression pattern.
📊 Output Options
Preserve Order Maintains the original order of unique lines.
Sort Output Alphabetically (A-Z, Z-A) or by line length.
Real-time Update Process as you type (disable for large files).
💾 Export Formats
- TXT - Plain text with line breaks
- CSV - Comma-separated values (one line per cell)
- JSON - Array format with unique values and metadata
⌨️ Keyboard Shortcuts
- Ctrl+Z - Undo last action
- Ctrl+Shift+Z - Redo
- Ctrl+A - Select all in current panel
- Ctrl+C - Copy selection
⚡ Performance Tips
For files with 100,000+ lines:
- Disable Real-time Update before pasting
- Disable Fuzzy Matching (it's computationally expensive)
- Click Process when ready (uses Web Worker for speed)