Oh Snap!
This job is no longer active - but you can still view the details below.

Senior Data Engineer

| Austin

You're looking for a role where you can drive decisions, be challenged and build a powerful and novel product. You want to collaborate with and mentor smart, creative, and energetic people. You’re comfortable with being uncomfortable and asking for help or finding your own answers when required. You look for projects where you can learn new technologies and techniques. You thrive in an environment based on autonomy and trust. If this sounds like you, you sound like someone we want on our team.

New Knowledge is a fast-growing technology company on a mission to defend public discourse. We use AI and machine learning to protect brands from disinformation attacks and are revolutionizing the way communities, companies, and industries respond to the spread of disinformation. We are led by successful entrepreneurs, NSA veterans and disinformation industry experts. Current clients include Fortune 100 customers across a number of industries and our investors include Moonshots Capital, GGV Capital and Capital Factory.

We are looking for Senior Data Engineers with 5+ years of experience as a professional software developer, 3 years or more of which have been in data engineering/ETL. This role will be based out of our Austin office.

What You’ll Do:

  • Design, develop and maintain New Knowledge’s data pipeline
  • Support and monitor pipeline performance in production
  • Take ownership of components of the data pipeline
  • Work with product managers and data scientists to understand upcoming work and design a system capable of meeting long-term product vision
  • Create and maintain documentation capable of describing how the pipeline works to a non-technical audience
  • Work as part of a team to integrate new services into New Knowledge’s data pipeline

What You Have:

Note: These are not hard requirements or an exhaustive list. Consider this an outline to give you a better understanding of what you’ll be doing. We expect a senior engineer to meet at least half of these requirements and be comfortable and excited to learn the rest.

  • Experience owning pieces or all of a data pipeline working as an ETL or data engineer
  • Experience working on data driven applications with data science and/or application engineers
  • Experience processing social media, text and image data is a plus
  • Experience or familiarity with Kafka or similar distributed systems (knowledge of schema registry/data types and serialization options and partition strategies a plus)
  • Experience with Docker and Kubernetes
  • Experience or familiarity with popular stream processing framework such as Spark Streaming, Kafka Streams, Flink or similar
  • Experience supporting large scale batch analytics in Hadoop ecosystem (loading and retrieving data)
  • Experience working with or building schedulers, workflow automation/coordination tools
  • Experience implementing tests and sanity checks on large complex data pipelines
  • Experience helping other developers write performant SQL queries
  • You enjoy working as part of a team and mentoring junior developers
  • You have strong written communication / documentation
  • You have a desire to code
  • You are not afraid to tackle problems you’ve never encountered before

What You’ll Get:

  • Chance to do purpose-driven work with smart, enthusiastic people
  • Competitive salary and healthcare
  • 401(k) with a 4% company match
  • A leadership team that trusts and embraces technology
  • Flexible work hours
  • Unlimited vacation that you’re encouraged to take
  • Stocked kitchen full of healthy snacks and Topo Chico
  • Annual stipend to purchase the gadgets, books, subscriptions, and other tools you need
  • Weekly catered lunches
  • Monthly team-wide events like Alamo Drafthouse movie screenings, escape rooms, and stand up paddleboarding
  • Many more benefits … apply to find out!
Read Full Job Description

Technology we use

  • Engineering
  • Sales & Marketing
    • JavascriptLanguages
    • PythonLanguages
    • RLanguages
    • SqlLanguages
    • Node.jsFrameworks
    • HubSpotCRM
    • SalesforceCRM

Location

We're located downtown, we're not in Capital Factory, there are 8 bars in a 1 block radius from our office, and we pay for parking. Mic drop.

An Insider's view of New Knowledge

What’s the vibe like in the office?

The vibe in the office is genuine and welcoming. Too many times tech companies try to contrive their culture, and tell people how they need to act. This couldn't be more different from New Knowledge. It's an environment that celebrates individuality, and welcomes new ideas.

Chelsey

Demand Generation Marketing Manager

What's the biggest problem your team is solving?

New Knowledge’s research division, NK Labs, is responsible for driving discoveries in emerging artificial intelligence and machine learning research through open-source DARPA programs — Data-Driven Discovery of Models (D3M) and Active Social Engineering Defense (ASED) — which we use internally to build tools to fight disinformation online.

Numa

Machine Learning Engineer

What are some things you learned at the company?

I have learned how to incorporate feedback from users to make models and statistics to answer multifaceted questions about communities on social media. I have also had the chance build APIs around my models in order to make them more accessible to users.

Becky

Data Science Manager

What is your vision for the company?

To bring authenticity to the internet. Most people believe the internet is a cocktail party at scale. In reality, the conversation online is driven by hyperactive mobs, or factions as we call them, that exploit platform dynamics to manipulate the narrative.

Jonathon

CEO

What's something quirky about your company?

A slightly unhealthy obsession with a futuristic cat that guides how we proactively pounce on this problem. Integrity, obsessive pursuit. nerdiness, collaboration, accountability, and teamwork are the DNA of our company. We are relentless in our pursuit, and IONCAT leads the charge.

Ryan

COO

What are New Knowledge Perks + Benefits

New Knowledge Benefits Overview

We are a startup company in the fun sense, we move quickly and get a lot done, but an established company when it comes to benefits. We have funding and revenue and we know the value of investing in our employees to grow New Knowledge. We offer Fortune 500 level health care benefits, vision + dental, free parking, a 401(k) and professional development opportunities.

Culture
Friends outside of work
Eat lunch together
Daily stand up
Open door policy
Team owned deliverables
Team based strategic planning
Group brainstorming sessions
Open office floor plan
Diversity
Highly diverse management team
Our leadership team is 50% female! New Knowledge is an autonomous company staffed with a diverse array of passionate, brilliant people who trust each other and love what they do.
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Wellness Programs
Onsite Gym
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Company Equity
Child Care & Parental Leave Benefits
Generous Parental Leave
We provide up to 14 weeks of parental leave for the primary caretaker. Acme Co. also provides 6 weeks of leave for the secondary caretaker.
Flexible Work Schedule
Family Medical Leave
Employees who have been with the company for 12 months are eligible for 12 weeks of family medical leave.
Return-to-work program post parental leave
Company sponsored family events
Acme co. sponsors family oriented events Quarterly.
Vacation & Time Off Benefits
Unlimited Vacation Policy
Paid Holidays
Paid Sick Days
Perks & Discounts
Beer on Tap
Casual Dress
Commuter Benefits
Company Outings
Stocked Kitchen
Some Meals Provided
Happy Hours
Parking
Free parking in our downtown office
Relocation Assistance
Professional Development Benefits
Job Training & Conferences
Mentorship program
Our mentorship program includes 1-to-1 program.

Additional Perks + Benefits

People love working here because they get a chance to do purpose-driven work with smart, dedicated colleagues! We like to treat our team by doing monthly team-wide events like Alamo Drafthouse movie screenings, escape rooms, and stand up paddle boarding. We take care of our employees by providing healthy lunches once a week and a variety of snacks and beverages throughout the week. We also offer an annual stipend to purchase the gadgets, books, subscriptions, and other tools you need to be successful and happy at work! There are many more benefits to working here at New Knowledge, just apply to find out!

More Jobs at New Knowledge4 open jobs
All Jobs
Data + Analytics
Dev + Engineer
Sales
Data + Analytics
new
Austin
Developer
new
Austin