Scripts used web scraping jobs

Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database

I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide source code, documentatio...

I need a script for NinjaTrader 8 that automatically marks a "untested" 60-minute high/low with a labeled line. This line should disappear once the level is tested by price touching it. I will send a video to those interested to show what I am referring to. The script should: - Automatically mark a...the level is touched by the price - Remove the line and label upon price going through the line (it does NOT have to close above or below the line, but it MUST go through the lines price by at least one tick. If price only touches the line, then the line and label should remain visible) -The project requires a freelancer with: - Proficiency in NinjaTrader 8 platform - Experience in creating scripts for automatic marking and labeling - Knowledge of market indicators and...

...and manage code and infrastructure such as cloud server, backend databases, APIs, and automation scripts. Help build powerful game ops tools with simple frontend UI. - - - Job Specs: - Create backend solutions and integrate with cloud platforms like AWS and Digital Ocean. - Design and deploy modern frontend user interfaces using the latest UI technologies. - Build secure and scalable mobile app REST APIs. - Manage databases using MySQL and NoSQL. - Use DevOps tools to monitor and scale applications. Looking For: - 3+ years of experience in software development - Experience with LAMP and MERN stacks - Knowledge of PHP, CSS, and JS and web technologies - Familiar with S3, cloud hosting, DNS, web security - Ability to use vanilla code and minimal libraries/framework...

...the script to accurately identify the face through the camera and ensure that the right person is in front of it. This is a crucial functionality for the script. - Desktop Application: The face recognition script should be developed as a desktop application. It should be user-friendly and easily accessible on Windows. I'm looking for a freelancer who has experience in creating face recognition scripts. Proper understanding of machine learning, computer vision, and security protocols will be a plus. Your proposal should include previous projects you have worked on that are similar to this one. Also, please state your timeframe for completion and your proposed cost. we use splitcam or obs to bypass bios id verification but it doesn't work in i need method to bypass it

Hi The task is to set up a password protected instance of the OWASP WebGoat running in AWS that is internet facing. To be successful the deployment must be: * Entirely automated using CloudFormation and bash scripts. * The landing page must be a public page protected with a username/password authentication block, this should rely upon CloudFront to perform authentication. The username and password should be configurable in the CloudFormation template. The landing page can be simple HTML that displays the username input, password input and login button. * A user friendly domain name should be configured via Route53 that is configurable in CloudFormation. The domain name can be provided if required. Obviously a AWS TLS1.3 PKI certificate is also required. * Behind the landing page ...

...S7yRgIOWSCFGSbQV7Xnlj?usp=sharing Here is our website: **Who we need based on our target audience:** - Female and Male between 35-44, (Mostly Female) - Mostly have a family and childrens or family oriented - Possibly a smoker or regular coffee drinker. **What we need:** - Make a Video about using our product for a few days using our scripts, you can come up with your own but basically we will provide everything. **From us:** - 50-70$ for a ready edited video 60 seconds long. (we can do the editing ourselves) - Our product you will keep and you can use it and save money for regular visits to the dentist. - Cooperation with a popular UK company - You can also make a video with your husband/wife and get more money if they are suitable

I'm looking for an experienced Python coder to tackle two key aspects of my project - data analysis and automation. Here's a breakdown of the requirements: - **Data Analysis**: The primary task involves analyzing datasets in CSV format. The selected candidate should be adept with NumPy, able to make sense of the data and d...**Strong Python Skills**: You should be well-versed with working on data analysis and automation tasks using Python. - **Experience with NumPy & Django**: Proficiency in these frameworks is a must. - **Data Analysis Background**: A background in data analysis will be a plus, helping you to not only automate but also interpret the data effectively. Your deliverables will be well-documented Python scripts that successfully handle data analysis and...

I'm in need of a concert ticket bot that can operate on several platforms, including Ticketmaster, Live Nation, ThaiTicketMajor, and BookMyShow Malaysia. The ideal bot should be able to perform sev...solving techniques or third-party captcha services if there is any available captcha yet to be solve, ensure scalability to handle high request volumes - Session tracking : the bot should extract and log the link for any session that successfully passes the queue The bot should be smart enough to navigate through the ticketing process of these platforms and complete the purchase. Experience in web scraping, automation, and ticketing bots, as well as knowledge of the mentioned platforms, is a must. If you can build a robust, reliable bot that meets these requirements, I�...

I'm looking for a motion graphics designer to create a series of 15-30 second movies, with a total of five films. The main goal of these movies is to educate a health-conscious audience about the benefits of a Low Carb diet. We have five scripts for you. Look in the bottom of this post to see how the scripts looks. Key Requirements: - Crafting engaging and informative 15-30 second motion graphic videos - Using provided scripts to create the movies - Targeting health-conscious individuals as primary audience The selected freelancer should have: - Demonstrable experience in creating educational motion graphic content - A portfolio showcasing previous work in the field - Understanding of the principles of designing for specific audiences, especially health-conscio...

Hi there! For our project, we are seeking an experienced developer who can adeptly work with React 18. Your role would consist of assisting us with the installation of essential scripts on our server. To excel in this role, it would be a plus if you possess knowledge of: - Node.js - MongoDB - GraphQL Although these specific skills would be advantageous, they are not mandatory. On another note, our preferred server management system for deploying the React application is Shared Hosting. Thus, any experience you have with server management and deployment processes, particularity Shared Hosting, would greatly benefit your application. With your expertise, we trust that you can help us successfully manage this project. Looking forward to potentially working with you!

...extraction from websites, dealing particularly with nested or hierarchical data. Key Responsibilities: - Collaborating with the team to define the scope of the project and identify the data requirements. - Design and implement data extraction scripts using the Scrapy framework. - Handle complex, nested or hierarchical data structures. - Ensure the accuracy and efficiency of the data extraction process. Ideal Skills and Experience: - Proven experience in Python development. - Expertise in working with the Scrapy framework. - Strong understanding of web technologies and data structures. - Excellent problem-solving and analytical skills. - Experience with handling nested or hierarchical data structures. - Previous experience in data extraction from websites is a plus. If ...

I'm looking for a skilled TouchDesigner and Python developer to create a script for automatically sending MOV videos as email attachments. Key Requirements: - Design and develop a Python script for TouchDesigner that can attach MOV videos to outgoing emails. - Ensure the script is robust, reliable and can handle various video sizes. - Email ...the TouchDesigner environment. - Testing and refining the script to ensure it performs reliably across different email platforms. - Creating mail input system Ideal Skills: - Proficiency in TouchDesigner and Python, with a proven track record of integrating the two for practical applications. - Experience in working with email systems and attachment handling. - Ability to test and troubleshoot scripts to ensure they deliver the required...

...expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be prepared to provide examples of your previous work...

I'm in search of a seasoned Pine script developer to design my custom strategy, which involves unique indicators. Here...unique indicators. Here's what's needed: - Design and implementation of my custom strategy on Pine Script - Integration of specific custom indicators - Focus on clarity and user-friendliness Ideal Skills and Experience: The perfect candidate for this job will be proficient with Pine script, TradingView, and understand different types of trading indicators. Prior experience in developing custom scripts will be a significant plus. Application Requirements: I want to see your past work. Show me a project, situate it in context, and tell me about the challenges you faced. This project will require excellent communication, so use your application to ...

...include: - Website development: The core of this project involves visualization of the key concepts, hence proficiency in creating efficient and visually appealing websites is a must. - Database integration: The website functionality will be backed by a responsive and robust database. Expertise in MySQL or similar database is critical. - Custom script development: You will need to develop tailored scripts to meet the specific needs of my project. Familiarity with CodeIgniter is essential for this project since we will be using this framework for our site. Given the complexity of the work, I prefer a mid-level developer who has substantial experience in the aforementioned areas. Your attention to detail, communication skills, and understanding of both front-end and back-end deve...

I'm looking for an experienced hacker who specializes in database scraping to assist with lead generation. My main aim is to get detailed contacts to grow my business. - Specific Tasks: - Database scraping - Extract contact details - Contact Information: - Email addresses - Phone numbers Ideal candidates should have previous experience in the field. Proficiency in data mining and scraping is a must, along with an understanding of lead generation strategies. Strong grips and successful track records on obtaining accurate contact details are key to perform this job efficiently.

...for our applications and Google Sheet. For each country may need API for such as : 1. Historical Data 2. Financial Scrapped Source 3. Financial Summary Scrapped Source 4. Interest rate 5. Some More Required Skill & Experience : 1. Php & SQL 2. Familiar with python installing & setting up environments 3. Experienced in Linux Debian & LNMP server by SSH 4. You need to know on how to run python scripts on debian by ssh, and setup cron task on debian, and debugging etc Personality's Criteria : 1. No toxic working environment 2. Agile, Responsive, and Fast Delivery 3. Collaborative as a team 4. Responsible, Credible, Reliable and Integrity person 5. No agency, only direct hiring ------ I'm looking for a skilled DevOps professional who can help in maintai...

...experience or interest writing scripts. We run a Tennis YouTube channel. Where we do player analysis, match recaps, narratives on different topics in the tennis world. If you do not watch/pay attention to tennis on an almost daily basis then this is not the right job for you. We also have a host for our channel so the script needs to be cohesive and casual enough for someone to read off of it without it sounding like a script. You will be responsible for writing (3,000~) word scripts 1-3 times a month, with reasonable turn around times if you are interested in applying, please show us examples of your previous work. We are looking for someone who is self-driven and makes sure that 100% of their information is correct and turns in scripts on time consistently. Th...

We are seeking an experienced skilled Raspberry Pi developer for an exciting machine workflow using Raspberry Pi and servo motors. The project involves developing software fo...developing software for control, and integrating the Modbus TCP/IP protocol. The successful candidate will demonstrate expertise in Python programming, servo control, and Modbus communication. Phase 1: Set up the Raspberry Pi 4b to control servo motors and configuring communication with the Panasonic Minas Driver and Panasonic Servo Motor. Install Modbus server software and develop custom Python scripts for Modbus communication and servo motor control. Phase 2: Control Iron Core Linear motors and configuring communication with the Mitsubishi Driver . This can turn into a long term project for the right ...

I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real-time. Prior experien...

I have a list of 50000 urls, I would like to scape the pages to see if they contain references to scripts - I will provide a list of the urls and the scripts. Deliverable should be an excel with the 50000 urls and whether they contain the link for each script. Looking for fast turnaround

I am seeking a skilled professional to install and configure scripts purchased from CodeCanyon. The tasks include: Downloading and extracting files. Setting up and connecting the database. Uploading files to the server. Running the installer and finalizing the configuration. Troubleshooting any post-installation issues. If you are an expert who can ensure a fast and efficient installation, please contact me for more details.

Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and associated promotions or deals....

...information and disease descriptions. Requirements: Programming Language: Preferably Python. Libraries: Experience with web scraping libraries like BeautifulSoup, Selenium, and data processing libraries like Pandas. Output Format: Ability to export data into an Excel file using Pandas or similar libraries. Error Handling: Robust error handling to manage failed requests and parsing errors. Compliance: Adherence to the websites' terms of service and rate limits to avoid being blocked. Project Scope: Input: A list of CRM numbers and a list of CID numbers. Process: Automate the lookup and data extraction process. Output: An Excel file with the compiled data. Skills Required: Web Scraping Python Programming Data Processing Automation Excel File Generation ...

...person within each company. This could be anywhere between 10 to 30 people per company. - The information should be accurate and up to date. - If you have a strategy for obtaining this data, please share it in your bid. Skills/Experience: - Strong research skills - Data entry and data mining expertise - Proficient in Saudi Arabian business landscape - Attention to detail and accuracy - Web scraping - Web search - Leads Results should be in an excel sheet format, outlining the name, position, email address for each contact. Contacts for each company should be grouped together, end file should be in 1 sheet, not separate sheets. Send me: 1- Your strategy in finding those companies and collecting names and emails of relevant employees, 2- Total number of expected V...

... Key requirements include: - Modify the existing Python script to incorporate the additional features required - Review the current script and ascertain that all existing functions are properly written and functioning as they should - Build a Debian OS image for COM (Computer-On-Module) installation that can be used to implement the updated python script seamlessly. Success in this role will require: - Proven experience with Python, specifically in writing and improving scripts with a focus towards integration with hardware - Solid knowledge and experience working with Debian operating system, especially in creating bootable Debian images for computer-on-modules (COMs) - A keen eye for detail and proficient debugging skills - Ability to work independently and deliver th...

Please Sign Up or Login to see details.

I'm looking to have a custom aimbot script made for a game that was released in 2004. This game has no anti-cheat, making the development process seemingly straight-forward for someone with experience in coding Gunbound scripts. The aim of this project is to create a basic aimbot script. I'm open to programming language suggestions, as long as it's optimal for the task at hand. I'm not interested in additional features at this stage, just a simple script to enhance aiming in the game. Ideal Skills: - Proficiency in coding custom aimbot scripts - Experience in Gunbound or similar game - Proficient in C++, Python, or AutoHotkey (preferred, but not mandatory) - Strong understanding of game mechanics Please provide details of your similar previous project...

a better formated pdf for this text is attached: I'm looking for a skilled freelancer to create a series of short ebooks/scripts about artificial intelligence. Below are the project details: Content Scope: The series should consist of 15 scripts, covering topics from Beginner to Medium levels. We make no books for AI-experts. Pages: 15-25 per script You can use ChatGPT for this Writing Guidelines: You can utilize ChatGPT or similar AI tools to assist in writing the content. Ensure all content is original and not copied from other books to comply with copyright laws. Write in a conversational style, as the scripts will be converted into audiobooks. Free visual graphics are welcome but not mandatory. If you use images, ensure they are properly licensed and provide ...

I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively

I need a skilled Pine Script coder for TradingView to help with extracting code from a restricted invite-only script. This script is accessible to me but is otherwise restricted. Key Responsibilities: - Extract the code from the restricted script - Perform major modifications as needed (e.g., changing algorithm,...This script is accessible to me but is otherwise restricted. Key Responsibilities: - Extract the code from the restricted script - Perform major modifications as needed (e.g., changing algorithm, adding/removing features) Ideal Skills and Experience: - Strong experience in Pine Script coding for TradingView - Proven track record of extracting and modifying code from restricted or invite-only scripts - Ability to make significant changes to a given algorithm, indicator o...

I need to Extract followers of group members of the link I will provide

...developer with experience on modding Call of Duty Black Ops 2 and bot development on Discord. The project objectives include: CUSTOM IN-GAME COMMANDS AND PERKZ - Creating custom Plutonium server settings for Black Ops 2 Zombies. - For the commands, i want there to be the basic commands that anyone can use, and “vip” commands for the players who have vip role. - Most if not all of the custom perks scripts i want have already been published on the plutonium forum. - Also needs stats tracking DISCORD BOT - Developing a Discord bot capable of linking a player's Discord account to their in-game GUID. - Granting players access to vip in-game commands thru the discord bot - in-game points rewards for when a player links their discord account to their in game guid ...

I am looking for a web-scraping expert to retrieve both images and text from a specific website for research purposes. The text data will need to be structured and saved in a CSV file, including paths to saved images. Key details to consider: - Knowledge of web scraping tools and techniques is essential to accomplish this task. - Quality control to ensure accurate data extraction and image quality is critical. - Structure page information and freeform descriptions should be made available in a CSV file. - The images should be saved in their original resolution and quality settings. Please provide any relevant experience you have in web scraping, including free and paid services you have used before to help with your work. I would like t...

I need a talented female who can craft engaging, 10-second jingles. - Emotion and Message: The jingles should convey a range of emotions from happy and cheerful, to calm and soothing, and also energetic and exciting. They need to strike a balance across all these emotions. - Target Audience: The creative work will be aimed at young adults, both male and female. - Length: Each piece should ...across all these emotions. - Target Audience: The creative work will be aimed at young adults, both male and female. - Length: Each piece should not exceed 10 seconds. Ideal candidates should have a grasp of music composition, concept development, and understand how to appeal to the young adult demographic. Experience creating short radio or advertising tunes is a plus. i am happy to provide s...

I need a professional who can help me with scraping data API from a specific website or platform. I'm looking to extract specific data points or information and potentially set up a regular scraping process. Key Requirements: - Proficiency in Web Scraping: I need someone who has experience with web scraping tools and techniques. - Data Mining Skills: The ability to identify and extract the specific data points I require is crucial. - Automation Expertise: If you have experience setting up automated scraping processes, that would be a huge advantage.

I require an individual proficient in VB macro script for Mach3. This project entails recreating a Mach4 script that particul... I have also a video how it works in mach4 fo refernece. You should be able to implement these specifications based on available documentation. Please remember that the recreated script should maintain as much fidelity to the original Mach4 script as possible. Ideal skills and experiences for the job include: - Familiarity with Mach3 and Mach4 CNC software - Expertise in creating VB macro scripts - Understanding of CNC machine operation, particularly regarding arc motion control, B/C axis, and zeroing their position - Ability to work with provided documentation for accurate script translation - Past experience in similar projects would be a significant ...

...but it's not functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or o...

I need a script that can scrape the Google Play store specific data from ...result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scraping solution - python experts, node.js experts If you think you're the right person for this job, please get in touch with your relevant experience and a brief overview of your proposed approach. The scrip...

I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!

I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you

We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (including ...

Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA

I'm in need of a creative and skilled writer to craft comedy skits for my TikTok channel. The highly engaging content should target an adult audience. Key Requirements: - Skilled in writing comedy scripts - Able to deliver in a storyboard format - Understanding of TikTok trends and audience preferences - Strong storytelling and joke-writing abilities The ideal freelancer should have a keen sense of humor, an understanding of the TikTok platform and be able to produce content that resonates specifically with an adult audience. I'm looking for skits that are funny, relatable and highly shareable.

I have a Node.js script that I've been using to sort and verify emails. However, there are some issues that I need to be fixed. I'm looking for a professional who can assist me in enhancing the script. Requirements: - The script should ...reliable, and the script should be able to handle a large list of emails efficiently. Key points for the project include: - Implementing a more efficient algorithm to handle large email lists without freezing. - Ensuring that the script provides accurate validation of email mailbox existence. Ideal Skills: - Strong proficiency in Node.js and email verification techniques. - Experience in optimizing scripts to handle large datasets without performance issues. - Good understanding of efficient algorithms and their implementation in real...

We are looking for developers who are proficient in WooCommerce and Google Sheet API to hel...a website, including product catalog, shopping cart, and payment gateway integration. - Implement integration with Google Sheet API for specific data processing & syncing requirements. Ideal Candidate: - Proficient in WooCommerce, including setting up product catalog, shopping cart, and payment gateway integration. - Experienced in integrating external APIs, specifically Google Sheet API, App Scripts Programming. - A good understanding of data processing and how to leverage Google Sheet for such purposes. The project has a flexible timeline, but ideally, we would like to get it completed as soon as possible. There are ample opportunity for the right candidates for a long term business...

I need historical stock prices and income statement data, deliver python script to collect this data for an arbitrary stock from google finance.

I've been working on ...script that I'd like to make accessible online through a web interface. This would involve uploading the script to a suitable web server and setting up a simple user interface. Key Requirements: - Deploy my Python script onto a web server, optimization for best performance. - Implement a basic but intuitive UI for the script. - Ensure it can be accessed by anyone without requiring user authentication. Ideal freelancer for this project should have: - Strong experience in deploying Python scripts to web servers. - Proficient in creating user-friendly web interfaces. - Familiarity with various web servers, especially as I'm undecided on a specific one. If you have experience in deploying Python scri...

Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, trooper501