Junior Data Engineer

| Austin

You're looking for a team where you can drive decisions, be challenged and build a powerful and novel product. You want to collaborate with smart, creative, and energetic people. You’re comfortable with being uncomfortable. You look for projects where you can learn new technologies and techniques. You’re comfortable designing, developing, testing, and launching software. You’re creative. And if this sounds like you, you sound like someone we want on our team.

New Knowledge is on a mission to defend public discourse. We build products that repair online communities, identify manipulation, and help them communicate more authentically. In a world where social media is being manipulated on a massive scale, this is no small task. We care about protecting communities, brands, and companies from being targeted by the spreading of disinformation. The kind of people who work with us have to be passionate about that challenge and mission.

While we take our mission very seriously, we are also a team of fun-loving, laid-back, self described geeks who love tacos and topo chico.

Summary:

We are looking for junior engineers with an interest in working on our data pipeline. The best candidates will have an interest in the state of the art stream and batch processing architecture and a strong desire to grow skills in this area.

What you’ll work on:

  • Work as part of a team to design, develop and maintain New Knowledge’s data pipeline
  • Support and monitor pipeline performance in production
  • Create and maintain documentation capable of describing how the pipeline work to non-technical audience
  • Work as part of a team to integrate new services into New Knowledge’s data pipeline using tools like Docker, Kubernetes, Kafka, PostgreSQL and more.

Skills:

These are not hard requirements or an exhaustive list. Consider this an outline to give you a better understanding of what you’ll be doing. We expect a junior engineer to meet at least half of these requirements and be comfortable and excited to learn the rest

  • Experience or familiarity plugging processes into Kafka or similar distributed systems
  • Experience or familiarity with popular stream processing framework such as Spark Streaming, Kafka Streams, Flink or similar
  • Experience supporting or writing batch analytics (relational and/or hadoop ecosystem)
  • Experience working with, configuring or supporting workflow automation/coordination tools like Airflow or Luigi
  • Understanding of how to evaluate data model, database indexes and how to evaluate a SQL query performance

Other notable skills:

  • Ability to monitor current solution to understand its limits and stay ahead of business needs
  • Work with senior engineers to research, prototype and implement new services and tools
  • Comfortable in a role where you will be constantly learning and working as a part of a team doing things no one in the company has done before

Who you are:

  • 1+ years professional software development
  • Experience with gathering/analyzing social media, text and image data is particularly relevant
  • Highly motivated to research, prototype and implement state of the art data pipeline in partnership with a team of engineers.
  • Comfortable with knowing what you do not know and asking for help or finding your own answers when required

Why we love working here: 

  • Competitive salary, 401(k) matching, and Fortune 500 level healthcare
  • We are a business that trusts and embraces technology and harnesses it for good. We embrace diverse ideas, autonomy and collaboration
  • Professional development opportunities–– we host lunch and learns, hold weekly 1-1’s, and have a policy where you can expense professional development books
  • A diverse leadership team that wants to uphold ethical practices in our software development process
  • A strong commitment to creating a diverse environment
  • Free parking in our building in downtown Austin
  • Free access to a gym in our office building
  • A $2,000 annual credit that you can spend on the technology and work gear of your choice
  • Parental leave (plan with your manager) and unlimited vacation (and no, that is not code for you never take a vacation, we encourage and value time off)
  • Weekly catered lunches and a stocked kitchen full of fruit, energy bars, popcorn, coconut water, and other healthy snacks


Read Full Job Description

Technology we use

  • Engineering
    • JavascriptLanguages
    • PythonLanguages
    • Node.jsFrameworks

Location

We love this area because of all the amazing local spots to eat or grab a beer, close proximity to tacos is very important. We also have free parking.

An Insider's view of New Knowledge

What’s the vibe like in the office?

The vibe in the office is genuine and welcoming. Too many times tech companies try to contrive their culture, and tell people how they need to act. This couldn't be more different from New Knowledge. It's an environment that celebrates individuality, and welcomes new ideas.

Chelsey

Demand Generation Marketing Associate

What's the biggest problem your team is solving?

Weaponized narrative and disinformation campaigns are storming into our lives over the Internet. It is incredibly rewarding to have a career where you can detect these activities and protect our institutions and the communities and discourse around them.

Dakota

Software Engineer

What are some things you learned at the company?

I have learned how to incorporate feedback from users to make models and statistics to answer multifaceted questions about communities on social media. I have also had the chance build APIs around my models in order to make them more accessible to users.

Becky

Data Scientist

How do you empower your team to be more creative?

What we do requires creativity from everyone in the company. The space is large and the problem unsolved - this isn't something anyone's built before. Our success depends on everyone looking for being resourceful and creative. We give people the tools they need, the problems we're facing and the guidance they may need to discover the right tools.

Sandeep

CTO

What makes someone successful on your team?

A slightly unhealthy obsession with protecting people, people who are driven to solve problems by relentless curiosity, and a technical ability to explore various data sets and persuasively present discoveries.

Ryan

COO

What are New Knowledge Perks + Benefits

New Knowledge Benefits Overview

We are a startup company in the fun sense, we move quickly and get a lot done, but an established company when it comes to benefits. We have funding and revenue and we know the value of investing in our employees to grow New Knowledge. We offer Fortune 500 level health care benefits, vision + dental, free parking, a 401(k) and professional development opportunities.

Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Pet Insurance
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Company Equity
Child Care & Parental Leave Benefits
Flexible Work Schedule
Vacation & Time Off Benefits
Unlimited Vacation Policy
Perks & Discounts
Beer on Tap
Casual Dress
Company Outings
Stocked Kitchen
Some Meals Provided
Happy Hours
Parking
Professional Development Benefits
Job Training & Conferences
More Jobs at New Knowledge20 open jobs
All Jobs
Data + Analytics
Design + UX
Dev + Engineer
HR
Internships
Marketing
Project Mgmt
Sales
Data + Analytics
new
Austin
Marketing
new
Austin
Sales
new
Austin
HR
new
Austin
Developer
new
Austin
Developer
new
Austin
Project Mgmt
new
Austin
Data + Analytics
new
Austin
Developer
new
Austin
Developer
new
Austin
Developer
new
Austin
Developer
new
Austin
Data + Analytics
new
Austin
Developer
new
Austin
Developer
new
Austin
Design + UX
new
Austin
Internships
new
Austin