AWS Data Engineer Job at Pi-Square Technologies LLC, Torrance, CA

YVhoekpHMjlxVHRWRHk4WmZMWTIybi91N0E9PQ==
  • Pi-Square Technologies LLC
  • Torrance, CA

Job Description

AWS Glue Developing ETL pipelines, working with Glue Catalog, and transforming data using PySpark

AWS Lambda Writing serverless functions (Python, Node.js) to process, move, or transform data

AWS S3 Managing storage, organizing Qualtrics input/output files, and optimizing data retrieval

AWS Step Functions Orchestrating Glue and Lambda jobs into automated workflows

AWS Athena Querying structured data stored in S3 for quick analysis

AWS CloudWatch & Logging Monitoring job execution and debugging errors

AWS MWAA airflow for Jobs orchestration

2. Data Processing & ETL Skills

Data Transformation & Aggregation Merging dealer master and dealer employee files into a single hierarchy file

ETL Workflow Automation Automating ingestion, transformation, and report generation

Data Format Handling Processing CSV, JSON, or XML files from Qualtrics

3. API & Integration Skills

Qualtrics API Extracting raw data, managing survey responses, and automating data pull

AWS Event-Driven Processing Triggering Lambda jobs based on new files arriving in S3

Integration with External Systems Connecting AWS with CRM, ERP, or BI tools

4. Data Analysis & Reporting

Data Validation & Quality Checks Ensuring accuracy in processed files before Qualtrics ingests them Report File Generation Formatting data outputs as per business-defined templates

Basic SQL & Athena Queries Extracting insights from processed data

5. Programming & Scripting

Python Writing data processing scripts for Lambda, Glue (PySpark), and automation

SQL Querying and managing structured datasets

Shell Scripting (Bash) Automating file movement and data preparation

6. DevOps & Security (Nice to Have)

IAM Permissions & Role Management Ensuring AWS services have correct access

Infrastructure as Code (IaC) Using Terraform or CloudFormation for AWS resource setup

CI/CD for Data Pipelines Automating deployment of Lambda and Glue scripts

Pi-square technologies is a Michigan (USA) Headquartered Automotive Embedded Engineering Services company, Synergy Partner for major OEMs and Tier 1s and their implementation partners in Automotive Embedded Product Development, Projects, Requirements Analysis, Software Design, Software Implementation, Efficient Build, Release Process, and turnkey software V & V Services. We have more than 20+ years of industry expertise with specialization in the latest cutting-edge automotive technologies such as Infotainment, connected vehicles, Cyber security, OTA, and Advanced Safety/ Body electronics.

Job Tags

Similar Jobs

Bobcat Transport

CDL Driver Regional Lease Opportunity Home Weekends 5 day runs Job at Bobcat Transport

Need Class A drivers who want to lease a truck with 6 months experience or more On weekends you choose how long you stay out ~ Regional runs nothing out West stay East of I35 Dedicated customers we have our own freight ~ All dry van no touch freight Earn...

Itaú Private Bank

Remote Customer Service Representative Work From Home Job at Itaú Private Bank

 ...Representative to join our team. If you love helping people and enjoy working from home, this could be the perfect fit for you.In this role, youll...  ...and chat to connect with customers and support them in real time.Were looking for someone whos patient, a good listener,... 

Trinity Employment Specialists

G Pipe Welder Job at Trinity Employment Specialists

 ...positions. The ideal candidate must be able to pass a 6G MIG/FCAW welding test and have at least 3 years of experience. This role...  ...welding Ability to pass a 6G welding test Knowledge of fabrication shop processes Reliable transportation (relocation assistance... 

Wasatch Truss, Inc.

Truss Manufacturing General Laborer Job at Wasatch Truss, Inc.

 ...of general laborers to start immediately. Shifts run 4 days per week. Day shift is from 6AM-4:30 PM Monday through Thursday. Night shift is from 2:30 PM-1:00 AM Tuesday through...  ...night owl we have the shift for you. No experience necessary, we will train. Must be at... 

T & K Pediatric Services

Speech Language Pathologist Job at T & K Pediatric Services

 ...or commute required* Welcome to T & K Pediatric Services - Speech Language Pathologist T & K Pediatric Services is a leading pediatric...  .... Qualifications Master's degree in Speech Language Pathology from an accredited program. Valid license to practice Speech...