Raydar Logo

Raydar

Data Engineer

Posted 19 Days Ago
Remote
Hiring Remotely in United States
180K-220K Annually
Senior level
Remote
Hiring Remotely in United States
180K-220K Annually
Senior level
Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.
The summary above was generated by AI

About the company

Our client builds AI-powered legal software for research and litigation workflows. Its products use large collections of court records and legal documents to help turn complex information into structured insights.

The role / why it matters

You will own the data pipelines that ingest, normalize, and enrich caselaw and docket records. Legal source data is messy, often arriving as scanned filings or semi-structured documents. The reliable signal you create will support downstream research and AI products.

What you'll do

• Build and maintain production pipelines for PACER, NYSCEF, state court systems, published opinions, and other legal records.

• Turn PDFs, scanned filings, XML, and HTML into clean, queryable data.

• Create LLM-assisted extraction workflows for legal text and validate results against source documents.

• Run statistical analyses, improve data quality, and optimize SQL queries.

• Support RAG and semantic search workflows in partnership with full-stack engineers.

• Operate and improve AWS S3 and RDS data systems within established security and compliance guardrails.

What we're looking for

• 4-8 years of experience building and operating production data pipelines with large, dirty datasets, and quickly finding signal in them.

• Strong Python and SQL skills for pipeline engineering and data analysis.

• Hands-on experience with legal data such as PACER records, court dockets, or court filings.

• Experience with AI for data, including RAG, semantic search, and LLM-assisted extraction, plus PDF parsing, OCR, and document extraction tooling.

• A bachelor's degree in Computer Science, Data Science, or a related field.

• Works fully autonomously and thrives with minimal management direction; stays curious about messy data problems and critically reviews AI-assisted code and outputs.

Bonus points

• Experience with regulatory or government data sources.

• Experience with vector databases or semantic-search tooling such as Pinecone or Voyage AI.

Compensation and benefits

• Base salary: $180,000-$220,000 USD.

• Equity: 0.15%-0.25%.

Location / work model

• Remote within the United States, with at least four hours of overlap with Eastern Time each workday.

• Strong preference for candidates based in the New York City area.

• Plan for quarterly travel to New York City.

• Visa transfers may be considered. New visa sponsorship is not available.

Similar Jobs

4 Days Ago
In-Office or Remote
113K-193K Annually
Senior level
113K-193K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead the architecture, design, and implementation of scalable data pipelines and enterprise data assets supporting healthcare rebate and Medicaid systems. Ensure data quality, governance, security, and CMS compliance while troubleshooting complex integration and performance issues. Collaborate with engineering, analytics, business, and leadership teams to translate requirements into technical solutions. Use cloud, big data, and approved AI technologies to improve productivity, mentor teams, and support evolving healthcare and financial applications.
Top Skills: Apache KafkaSparkAWSAzureDatabricksDelta LakeFhirHl7Ibm I Db2JavaPythonScalaSnowflakeSQL
11 Days Ago
Remote or Hybrid
209K-262K Annually
Senior level
209K-262K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Design, build, and operate scalable cloud data pipelines, platforms, and applications using distributed data technologies. Lead architectural decisions, evaluate platforms such as Snowflake and Databricks, establish engineering patterns, and deliver resilient data solutions. Collaborate with product managers, software engineers, analysts, and data scientists while mentoring engineers and communicating technical outcomes to stakeholders. Drive large-scale data initiatives independently in an Agile environment.
Top Skills: AgileAirflowAWSCassandraDagsterDatabricksDynamoDBEmrGlueGCPJavaAzureMongoDBMonte CarloNoSQLPythonRedshiftScalaSnowflakeSparkSplunkSQL
14 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
99K-167K Annually
Mid level
99K-167K Annually
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Build and maintain reliable data pipelines, computed tables, and scalable data models using SparkSQL and PySpark. Integrate IoT, product, customer, external, unstructured, and ML-related data into a central data lake for analytics, causal inference, model training, and dashboards. Ensure high data quality and uptime while collaborating with data science, analytics, AI/ML, and engineering teams.
Top Skills: Apache AirflowAWSAzureDagsterData LakeData ModelingData PipelinesDatabricksDelta LakeETLGCPGitGitPrefectPysparkPythonRest ApisSparksqlSQL

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account