Web/App Data Mining Engineer (Python, JSON)

Mô tả công việc

• Participate in real-world web and mobile app data mining projects in collaboration with leading Korean companies.
• Develop, maintain, and improve data collection solutions for websites and mobile applications, primarily across e-commerce platforms, social media, and other digital platforms.
• Work on various aspects of the data mining lifecycle, including: 
  • Web Data Mining: Develop and maintain data extraction scripts and automated crawlers for websites and web applications.
  • Mobile App Data Mining: Research and implement data collection approaches for mobile applications, particularly Android-based platforms.
  • API & Network Analysis: Explore web and mobile application APIs, network requests, and data structures to understand how data can be collected.
  • Automation Development: Build Python-based scripts, backend services, and automation tools to support data collection activities.
  • Data Processing: Extract, clean, transform, and organize collected data into structured formats.
  • Monitoring & Troubleshooting: Monitor scraping activities, investigate failures, and improve the reliability of data collection processes.
  • Performance Improvement: Continuously improve scraping efficiency, stability, and maintainability.
• Research new technologies, tools, and approaches to solve challenging data collection problems.
• Collaborate with other engineers to develop practical and scalable data mining solutions.

Take increasing ownership of data mining projects as technical knowledge and experience grow.

Yêu cầu công việc

REQUIREMENTS

• Experience: At least 3 years of professional software development experience in web or mobile application environments. Previous Frontend or Backend Engineers are welcome.
• Programming: Good proficiency in Python, with practical software development and debugging experience.
• Web Technologies: Good understanding of web technologies, including HTTP/HTTPS, REST APIs, JSON, HTML, JavaScript, and client-server communication.
• Software Engineering: Experience developing, maintaining, and troubleshooting applications or backend services.
• Problem-Solving: Strong analytical thinking, technical curiosity, and willingness to investigate unfamiliar systems.
• Interest in Data Mining: Strong interest and passion for web and mobile app data mining, with a clear intention to build a long-term career specializing in this field.
• Learning Mindset: Self-motivated, proactive, and willing to learn new tools and technologies to solve real-world engineering challenges.
• Communication: Ability to communicate effectively and collaborate with technical teams.

Prior professional scraping or data mining experience is not mandatory. We welcome experienced software engineers who are passionate about transitioning their careers into data mining.

PREFERRED QUALIFICATIONS

• 5+ years of software engineering experience, particularly with hands-on experience in web scraping, mobile app data mining, or data extraction.
• Practical experience with scraping and automation tools such as Playwright, Selenium, Puppeteer, Scrapy, or BeautifulSoup.
• Experience with JavaScript/TypeScript (Node.js) backend development.
• Familiarity with mobile app automation or debugging tools such as Appium, ADB, mitmproxy, or Charles Proxy.
• Experience analyzing APIs, network traffic, and application data flows.
• Familiarity with Linux, Docker, Git, and SQL/NoSQL databases.
• Exposure to cloud platforms such as AWS or GCP.
• Experience developing automation scripts, scheduled jobs, or data processing pipelines.
• Experience working with e-commerce, social media, or other large-scale online platforms.

Candidates with 5+ years of experience and strong expertise in data mining will be highly valued.