Data Engineer

Sorry, this job was removed at 12:54 p.m. (CST) on Tuesday, October 1, 2019
Find out who's hiring in Austin.
See all Data + Analytics jobs in Austin
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

Come work at Smarter Sorting!

About Us

Smarter Sorting is a purpose-driven company committed to increasing sustainable options for unsold or damaged products. Our cutting-edge machine learning technology enables cost-effective, compliant decisions for all unsold products, and our process advances our partners’ zero-waste goals.

As a collective group of machine learning experts, successful serial entrepreneurs, data scientists, sustainability experts, and national account program managers, our passion for data-driven sustainability drives us toward a singular goal: to reduce waste through the salvation of unwanted items. Our goal is to take valuable products current being driven hundreds of miles and burned and have them be used for their original purpose in local communities.

At Smarter Sorting: We do what it takes. We are driven to become experts. We are not jerks. We are real. We have grit. A healthy culture is key to our company’s success and more importantly our employees’ happiness. Our core values drive our culture and in turn, we achieve our vision.

Better decisions. Better data. Greener planet. All made possible by the best people. Come join our team!

About You

Smarter Sorting is seeking a Data Engineer to help architect and develop scalable solutions. Our Data Engineer will work cross-functionally with our Data Scientists to fully automate our ETL (extract, transform, load) pipelines. The end-goal would be to make adding a new data source as simple as filling out a configuration file and adding it to a queue. They will also monitor and manage data ingestion as well as clean existing data. Our Data Engineer will define data models, update the ETL to interface with the new data store, and manage the migration from Mongo to Postgres.

What You'll Be Doing

  • Design and build scalable data ETL pipelines and processes
  • Research and incorporate new data sources into the system
  • Manage both Postgres and Mongo environments
  • Identify, design, and implement internal process improvements, including but not limited to: automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability
  • Collaborate with Data Scientists to determine data requirements and respond to data requests
  • Perform maintenance and clean up existing data and data sources
  • Research and incorporate new data sources into the system

Your Experience + Skills

  • BA/BS in Computer Science, Management Information Systems, Mathematics, Statistics, Engineering or related degree
  • 5+ years of experience working with ETL (extract, transform, load) pipelines
  • 3+ years of SQL experience
  • 1+ years of Mongo experience
  • Experience with Python
  • Experience with data migration projects
  • Working knowledge of object-oriented programming
  • Experience creating large data cleansing and management automation systems
  • Experience supporting and working with cross-functional teams in a dynamic environment
  • Strong understanding of security considerations

Your first month

  • Demonstrate understanding of our data architecture
  • Perform data quality analysis
  • Complete organizational onboarding

Your first 3 months

  • Create the data migration plan and timeline
  • Develop data ingestion automation from Amazon Mechanical Turk
  • Complete data cleansing

Your first 6 months

  • Complete the data migration from Mongo to Postgres
  • Create automated data quality monitoring systems
  • Improve data processing capacity by 50%

Your Benefits & Perks

Smarter Sorting offers:

-Competitive Compensation Packages

-Medical, dental & vision insurance

-401k program

-Short-term disability insurance

-Unlimited PTO

-Continuing Education & Lunch N Learns

-Bi-Annual All-Hands

-Volunteering & Special Events (with baby goats in attendance)

-Snacks, drinks, lunches, and dinners

Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Location

We're at the corner of E 6th Street and Medina, yoga studios, cafes, and bicycle shops are on our block.

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about SmarterXFind similar jobs