Debug Slow Spark Job
EmbrasureAI/spark-observability-skillsDiagnose slow, expensive, or regressed Apache Spark and PySpark applications by comparing runtime evidence against a healthy run. Use for long stages, stragglers, skew, shuffle, spill, garbage collection, poor parallelism, small files, slow scans, scheduler delay, executor imbalance, and unexplained compute-cost growth.
At a glance
This skill is for Coding.
git clone --depth 1 https://github.com/EmbrasureAI/spark-observability-skills
cp -r spark-observability-skills/skills/debug-slow-spark-job ~/.claude/skills/debug-slow-spark-job
Also in EmbrasureAI/spark-observability-skills
View the repoDiagnose failed Apache Spark and PySpark applications from History Server evidence, logs, and cluster-manager state. Use for driver or execu...
Optimize Apache Spark SQL and DataFrame queries using the final Adaptive Query Execution plan and runtime statistics rather than source code...
Other Coding skills
Behavioral guidelines to reduce common LLM coding mistakes. Use when writing, reviewing, or refactoring code to avoid overcomplication, make...
Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI be...
Guide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-design...
Reference for the Claude API / Anthropic SDK — model ids, pricing, params, streaming, tool use, MCP, agents, caching, token counting, model...
Suite of tools for creating elaborate, multi-component claude.ai HTML artifacts using modern frontend web technologies (React, Tailwind CSS,...
Create a detailed refactor plan with tiny commits via user interview, then file it as a GitHub issue. Use when user wants to plan a refactor...