久久精品一二区_久久精品一级片_久久精品一区二区三区四区_久久精品一区视频_一个人晚上高清视频ww_一个色综合久久

Position Overview We are seeking a skilled Data Engineer to design, build, and optimize our data pipelines and infrastructure. The ideal candidate will have strong experience in handling large-scale video datasets and building efficient data processing systems for machine learning applications. Key Responsibilities ?Design and implement scalable data pipelines for processing, storing, and managing large-scale video datasets ?Build and maintain data infrastructure for training data preparation and feature engineering ?Develop efficient ETL processes for various data sources including videos, images, and metadata ?Create and optimize data storage solutions for high-performance data access ?Implement data quality monitoring and validation systems ?Collaborate with ML researchers to support model training and evaluation needs ?Ensure data security and compliance across all data operations Required Qualifications ?Master's degree in Computer Science, Software Engineering, or related field ?8+ years of experience in data engineering roles at tech companies ?Strong programming skills in Python, Java, SQL and Shell ?Experience with big data technologies (Spark, Hadoop ecosystem) ?Proven track record in building and maintaining data pipelines ?Experience with cloud platforms (AWS/GCP/Azure or Alibaba Cloud/Tencent Cloud) ?Strong understanding of data modeling and database design Preferred Qualifications ?Experience with video processing and storage systems ?Knowledge of ML/AI data pipeline requirements ?Familiarity with distributed computing systems and high-performance computing ?Experience with streaming data processing ?Understanding of data privacy and security best practices ?Experience with Cloud services and data infrastructure ?Bilingual proficiency (English/Chinese) Technical Skills Data Processing & Storage ?Databases: PostgreSQL, MongoDB, Redis ?Big Data: Spark, Hadoop, Hive ?Data Warehousing: Snowflake, Amazon Redshift ?Stream Processing: Kafka, Apache Flink Cloud & Infrastructure ?Cloud Platforms: AWS/GCP/Azure, Alibaba Cloud/Tencent Cloud ?Container Orchestration: Docker, Kubernetes ?Infrastructure as Code: Terraform, Ansible Programming & Tools ?Languages: Python, SQL, Shell scripting ?ETL Tools: Airflow, Luigi ?Version Control: Git ?Monitoring: Prometheus, Grafana Video Processing ?FFmpeg, OpenCV ?Video compression and optimization techniques ?Video metadata extraction and management What We Offer ?Opportunity to build critical infrastructure for cutting-edge AI technology ?Competitive salary and equity package ?Flexible work arrangements ?Professional development opportunities ?Modern tech stack and tools ?Collaborative and innovative work environment ?Health and wellness benefits Location ?Hong Kong (on-site, Hong Kong Science and Technology Park) Expected Impact ?Shape the foundation of our data infrastructure ?Influence architectural decisions ?Build and mentor a world-class technology team