DomainClaw

Allow users to input multiple domains and quickly check whether each domain is reachable before running a deeper crawl.

Description¶

Implement a fast precheck flow where the user can enter domains using either one domain per line or comma-separated values.

For each domain, the system should perform a lightweight HTTP check and return the core validation result.

The precheck result should include:

• DNS result
• HTTP status code
• Redirect count
• Final URL

After the precheck is complete, the user should be able to select which domains should be passed into the deep crawl step.

Acceptance Criteria¶

• The user can input a list of domains from the UI.
• The system can run a fast precheck for each domain.
• The result table displays the required columns:
  • DNS
  • Status code
  • Redirect count
  • Final URL
• The user can select one or more domains from the precheck result.
• Only selected domains are passed to the deep crawl step.

Definition of Done¶

• The precheck flow can be completed entirely from the UI.
• A failed domain does not crash the entire batch.
• Errors are handled per domain and shown clearly.
• The selected domain list is correctly passed to the next step.