Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SearchScraper #30

Merged
merged 7 commits into from
Feb 3, 2025
Merged

SearchScraper #30

merged 7 commits into from
Feb 3, 2025

Conversation

PeriniM
Copy link
Contributor

@PeriniM PeriniM commented Feb 3, 2025

πŸš€ Major API Update: SearchScraper Addition & SmartScraper Enhancement

πŸ”„ Changes

✨ New Features

  • Added SearchScraper endpoint (πŸ”) for AI-powered web searches with reference URLs
  • Enhanced SmartScraper (πŸ€–) to handle both webpage URLs and HTML content

πŸ”€ Consolidation

  • Merged LocalScraper functionality into SmartScraper
  • SmartScraper now accepts either website_url or website_html parameter

πŸ“ Documentation

  • Updated API reference and examples
  • Added new schema examples for structured search results
  • Updated READMEs with new capabilities

🎯 Benefits

  • Simplified API surface with fewer endpoints
  • More flexible content extraction options
  • New search capabilities with source attribution
  • Consistent AI-powered processing across all features

πŸ§ͺ Testing

  • Added comprehensive tests for new SearchScraper endpoint
  • Updated SmartScraper tests to cover HTML input
  • All existing tests passing βœ…

@PeriniM PeriniM merged commit c435542 into pre/beta Feb 3, 2025
2 checks passed
@PeriniM PeriniM deleted the feat-searchscraper branch February 3, 2025 16:39
Copy link

github-actions bot commented Feb 3, 2025

πŸŽ‰ This PR is included in version 1.9.0-beta.7 πŸŽ‰

The release is available on:

Your semantic-release bot πŸ“¦πŸš€

Copy link

github-actions bot commented Feb 3, 2025

πŸŽ‰ This PR is included in version 1.11.0-beta.1 πŸŽ‰

The release is available on:

Your semantic-release bot πŸ“¦πŸš€

Copy link

github-actions bot commented Feb 3, 2025

πŸŽ‰ This PR is included in version 1.11.0 πŸŽ‰

The release is available on:

Your semantic-release bot πŸ“¦πŸš€

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant