Web Scraping Optimization

Enhancements:

• Integrated undetected-chromedriver to bypass anti-bot services like Cloudflare, Distill Network, Imperva, DataDome, and Botprotect.io.

• Updated Selenium options to enhance detection evasion, including disabling automation features and using headless mode.

Improvements:

• Refactored SeleniumDriver class to use undetected-chromedriver for more robust scraping of protected websites.

• Added a script to modify the navigator.webdriver property to undefined to avoid detection.

Bug fixes:

• Fixed an issue with unrecognized Chrome options (excludeSwitches) causing invalid argument errors.

• Enhanced logging to capture browser console errors for better debugging.

Enhanced Content Review Notifications

Improvements:

• New "Accept" and "Edit" Buttons. Accept Button: automatically updates the content status to 'scheduled' upon user acceptance. Edit Button: redirects the user to a specific URL to edit the content before scheduling.

Improvements:

• Row-Level Security (RLS). Row-Level Security (RLS) policies implemented to ensure fine-grained access control to sensitive data within the database.

• User-Related Tables Creation Sequence. Execute the sequence for creating user-related tables to ensure proper schema setup and data integrity across the application.

Bug Fixes:

• Save Channel Name to Generated Content. Resolved the bug preventing the channel name from being saved to the generated content.

• Save Date and Time in UTC with Timestamps. Resolved the bug causing date and time not to be saved in UTC format with proper timestamps.

• Google Authentication Fix. Resolved issues related to user authentication via Google.

• Email Authentication Fix. Resolved issues related to user authentication via email.

New Features:

• Extract image url from LLM response. You can now extract memes images from memes.com and post them right in telegram 👌

• Get notified when content is ready for review

• Generate content preview

Improvements:

• Client side error handling for failed generations.

• Delete tasks function.

• HTML styling for Telegram messages.

Bug Fixes:

• Issue with email authentication.

New Features:

• Easily create new tasks by applying pre-defined templates.

• Utilize Llama-index RAG to efficiently handle and analyze RSS and webpage content.

Improvements:

• Client side toast notifications

• Channels verification for user

• Hide "New task" button if request was being sent and ok

Initial deploy