Data Engineer

Who We Are:
PlanetArt’s mission is to be the leading online destination for personalized cards, wall art & home décor, and other personalized products. We provide consumers with unmatched tools, content, and an end-to-end customer experience that results in high-quality and meaningful finished products and memorable celebrations of life events. To learn more, visit
Overview:
We seek a seasoned Data Engineer with expertise in Apache Spark, and scalable
data pipeline architecture to join our team. This role will focus on developing robust
data processing and aggregation pipelines from multiple database sources,
supporting large-scale time series ndidate should be skilled in
developing data pre-processing. This role also demands proficiency in code testing
methodologies to ensure the reliability and quality of our solutions.
Key Responsibilities:
Design and implement scalable data pipelines using Apache Spark for data pre-processing, aggregation, and feature engineering.
Work closely with Data Scientists and ML Engineers to ensure the prepared data is suitable for building machine learning models.
Write production-level code and document the developed solutions for easy maintenance and novate and implement data pipelines to support feature engineering techniques to enhance model accuracy and efficiency.
Experience with big data tools and ecosystems (e.g., Spark, Polars).
Build and maintain data lake (eg. S3 or Delta Lake) solutions for efficient data storage and retrieval.
Ensure data quality, reliability, and efficiency of the entire velop and apply rigorous testing methodologies, such as Unit Testing, to ensure code reliability and functionality.
Qualifications:
Familiarity with Apache Spark, including PySpark, for large-scale data processing.
Strong programming skills in Python and SQL, with experience in handling diverse data formats and sources.
Excellent problem-solving, communication, and team collaboration skills.
Working Arrangements:
Part-Time (4 to 6 hrs per day) or Full-Time Independent Contractor
Monday to Friday (up to 40 hours per week)
9 AM to 6 PM Pacific Time
This is a work-from-home position.
Work-from-Home Requirements:
Own computer (Windows 10 or higher, at least 8GB RAM, and at least Intel i5 or Ryzen 5 processor)
Reliable high-speed internet access
Noise-canceling headset (if applicable)
Private, distraction-free environment (if applicable)
Start Date:
Immediately
Compensation:
P95,000 to P165,000.00 per month (Full-Time)
?P550 to P950 per hour (Part-Time)