Tham gia các dự án khai thác dữ liệu web/mobile cho các công ty Hàn Quốc lớn, xây dựng giải pháp thu thập dữ liệu cho web và ứng dụng di động.
Yêu cầu
Từ 3 năm kinh nghiệm phát triển phần mềm trong môi trường web hoặc mobile
Khả năng tốt trong Python với kinh nghiệm phát triển và debug thực tế
Hiểu biết về công nghệ web: HTTP/HTTPS, REST API, JSON, HTML, JavaScript
Trách nhiệm
Xây dựng và duy trì script trích xuất dữ liệu và crawler tự động cho web
Nghiên cứu và triển khai phương pháp thu thập dữ liệu cho ứng dụng di động (Android)
Phân tích API, yêu cầu mạng và cấu trúc dữ liệu để thu thập dữ liệu
Viết script Python, dịch vụ backend và công cụ tự động hóa hỗ trợ thu thập dữ liệu
Có thì tốt
5+ năm kinh nghiệm phần mềm, đặc biệt trong web scraping, data mining trích xuất dữ liệu
Kinh nghiệm thực tế với các công cụ: Playwright, Selenium, Puppeteer, Scrapy, BeautifulSoup
Kinh nghiệm với JavaScript/TypeScript (Node.js) backend development
Tóm tắt bằng AI từ JD gốc, đọc JD gốc trước khi ứng tuyển.
Mô tả công việc
Participate in real-world web and mobile app data mining projects in collaboration with leading Korean companies.
Develop, maintain, and improve data collection solutions for websites and mobile applications, primarily across e-commerce platforms, social media, and other digital platforms.
Work on various aspects of the data mining lifecycle, including:
Web Data Mining: Develop and maintain data extraction scripts and automated crawlers for websites and web applications.
Mobile App Data Mining: Research and implement data collection approaches for mobile applications, particularly Android-based platforms.
API & Network Analysis: Explore web and mobile application APIs, network requests, and data structures to understand how data can be collected.
Automation Development: Build Python-based scripts, backend services, and automation tools to support data collection activities.
Data Processing: Extract, clean, transform, and organize collected data into structured formats.
Monitoring & Troubleshooting: Monitor scraping activities, investigate failures, and improve the reliability of data collection processes.
Performance Improvement: Continuously improve scraping efficiency, stability, and maintainability.
Research new technologies, tools, and approaches to solve challenging data collection problems.
Collaborate with other engineers to develop practical and scalable data mining solutions.
Take increasing ownership of data mining projects as technical knowledge and experience grow.
Yêu cầu công việc
REQUIREMENTS
Experience: At least 3 years of professional software development experience in web or mobile application environments. Previous Frontend or Backend Engineers are welcome.
Programming: Good proficiency in Python, with practical software development and debugging experience.
Web Technologies: Good understanding of web technologies, including HTTP/HTTPS, REST APIs, JSON, HTML, JavaScript, and client-server communication.
Software Engineering: Experience developing, maintaining, and troubleshooting applications or backend services.
Problem-Solving: Strong analytical thinking, technical curiosity, and willingness to investigate unfamiliar systems.
Interest in Data Mining: Strong interest and passion for web and mobile app data mining, with a clear intention to build a long-term career specializing in this field.
Learning Mindset: Self-motivated, proactive, and willing to learn new tools and technologies to solve real-world engineering challenges.
Communication: Ability to communicate effectively and collaborate with technical teams.
Prior professional scraping or data mining experience is not mandatory. We welcome experienced software engineers who are passionate about transitioning their careers into data mining.
PREFERRED QUALIFICATIONS
5+ years of software engineering experience, particularly with hands-on experience in web scraping, mobile app data mining, or data extraction.
Practical experience with scraping and automation tools such as Playwright, Selenium, Puppeteer, Scrapy, or BeautifulSoup.
Experience with JavaScript/TypeScript (Node.js) backend development.
Familiarity with mobile app automation or debugging tools such as Appium, ADB, mitmproxy, or Charles Proxy.
Experience analyzing APIs, network traffic, and application data flows.
Familiarity with Linux, Docker, Git, and SQL/NoSQL databases.
Exposure to cloud platforms such as AWS or GCP.
Experience developing automation scripts, scheduled jobs, or data processing pipelines.
Experience working with e-commerce, social media, or other large-scale online platforms.
Candidates with 5+ years of experience and strong expertise in data mining will be highly valued.
