Senior Data Engineer
Senior Data Engineer, Brightly Software, Inc., Cary, NC. May telecom in US & rprt to Cary, NC site & if telecom, may req trvl to Cary, NC for mtgs. Build new data ingestion pipeline into data cloud & guide future data infrastructure decisions. Reqs Master / Bach in CS, IT Mgmnt, Engg, Data Sci/Anlytcs / rel / equiv. Reqs, if Master 5 yrs / if Bach 7 yrs, exp in: SW / data engg; data integrate (ETL / ELT) devel w/ multi langs incl Java, Scala, Python, PySpark / SparkSQL; build & maintain data pipelines supp variety of integrate patterns; build & maintain data lake / w/h in prod environ wrkng w/ data formats like Parquet, CSV, JSON, YAML / XML; wrkng w/ rel DBs usng SQL & develpng complx SQL queries, stored procedures & UDFs, troubleshoot & perf tuning; usng agile best practices like Jenkins, Git / JIRA; build & rationalize data environs w/ complex variety of data pipelines; 3 yrs: utilizng AWS-based data srvce techs like Glue srvcs fam, RDS, Athena / Snowflake & cloud store & compute incl S3, EC2, Lambda, & Step Functions. M-F 8 a.-5 p. Occasionl outside hrs & wkend spprt req'd. All hires sbmt to drug scrn & BG chck. M-F, 40 hrs/wk. Apply: resume to: heather.copeland@brightlysoftware.com ref job #111495