Train and operate machine learning models on Amazon SageMaker using AWS Trainium. Develop and optimize PyTorch training code for NeuronCore hardware, diagnose device and compiler issues, tune distributed workloads for throughput and cost, and deliver production training pipelines while collaborating directly with client and engineering teams.
Robots & Pencils is an AWS Partner building production AI systems for enterprise clients who need real engineering, not proofs of concept that never ship. We work forward-deployed, embedded directly with client teams, solving the problems that are too new or too specialized for a typical vendor relationship to handle.
The Role
We're looking for an engineer who can operate and train models on Amazon SageMaker running on AWS Trainium, AWS's custom silicon built specifically for large-scale model training. This isn't a role where you call an API and wait. You'll be walking up the stack: understanding what a training request actually looks like at the Trainium hardware and compiler level, then carrying that understanding all the way up through PyTorch training code and into a production SageMaker pipeline.
PyTorch is the backbone of this work. If you know the framework deeply and you're comfortable reasoning about how your code actually behaves on custom accelerator hardware rather than treating it as a black box, this role is built around that skill set specifically.
What You'll Do
- Train and operate models on Amazon SageMaker with AWS Trainium as the underlying compute
- Write and optimize PyTorch training code with a real understanding of how it compiles and executes on Trainium (NeuronCore architecture, compiler behavior, memory and throughput tradeoffs)
- Diagnose training run issues that show up specifically because of the hardware, not just the model, distinguishing a data or code problem from a compiler or device-level one
- Translate a request for "a Trainium job" into an actual working, cost-aware training pipeline, end to end
- Tune distributed training runs for throughput and cost on SageMaker's training infrastructure
- Work directly with client and internal engineering teams to scope and deliver real production training workloads, not experiments that stay in a notebook
What You'll Bring
- Strong, hands-on PyTorch experience, ideally including distributed or multi-device training
- Production experience with Amazon SageMaker for training and/or inference
- Comfort working close to the hardware layer: you understand device-specific compilation and can debug issues that are actually about the accelerator, not just the model
- AWS Trainium or Inferentia (Neuron SDK) experience is a strong plus; if you don't have it yet but have deep PyTorch and a track record of picking up new hardware targets fast, we want to talk to you
- Solid Python fundamentals and comfort operating in a client-facing, production engineering environment
Similar Jobs
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Own carrier connectivity for a commercial insurance platform, solving complex integration problems from diagnosis through production. Define technical solutions involving APIs, authentication, data contracts, error handling, and system architecture. Coordinate priorities and delivery across multiple product and engineering teams, measure connectivity performance, partner with carriers and internal product leaders, and communicate tradeoffs and progress to executives.
Top Skills:
AcordAi-Assisted ClassificationAi-Assisted ExtractionAuthentication And AuthorizationCallbacksCytoraData MappingData NormalizationEpicIngestion PipelinesIvansRest ApisWebhooks
Big Data • Fintech • Mobile • Payments • Financial Services
Lead technical strategy and execution for a full-stack card experiences team. Design and launch scalable backend systems and web or mobile applications, collaborate with product, design, analytics, risk, and operations, and own features from problem definition through production monitoring. Improve reliability, on-call operations, code quality, and technical standards while mentoring engineers and applying AI thoughtfully.
Top Skills:
SparkAWSKotlinKubernetesMySQLPythonReactReact NativeVue
.png)
Healthtech • Social Impact • Telehealth
Provides compassionate intake and care-navigation support for older adults and their families. Guides patients through the onboarding process, coordinates therapist matching, answers questions, and helps patients feel supported entering mental healthcare. Requires strong communication, organization, empathy, attention to detail, and comfort learning healthcare and CRM software. The role is fully remote and limited to candidates based in Canada.
Top Skills:
Crm SoftwareEhr PlatformsGoogle WorkspaceHealthieHubspot
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
