Issues

• feat(python): Plug into DataFusion Python natively through a custom FFI query planner

  api-changepython
  apache/datafusion-ballista#2618 · Filter by author milenkovicm opened on Oct 18, 2026

• [EPIC] Reduce complexity and duplication hotspots in Ballista

  enhancementhelp wantedtech debt
  apache/datafusion-ballista#2606 · Filter by author andygrove opened on Oct 14, 2026
  2

• TUI: collapse repeated sort-order blocks in JobsData::sort_jobs and share table scrolling helpers

  enhancementgood first issuehelp wantedtech debtTUI
  apache/datafusion-ballista#2605 · Filter by author andygrove opened on Oct 14, 2026
  3

• BallistaClient: share retry logic between execute_do_get and execute_do_action_with_header, and don't panic when io_retries_times is 0

  enhancementgood first issuehelp wantedrusttech debt
  apache/datafusion-ballista#2604 · Filter by author andygrove opened on Oct 14, 2026

• TUI: unify App::on_key and App::on_key_sync so key handling lives in one place

  enhancementhelp wantedtech debtTUI
  apache/datafusion-ballista#2602 · Filter by author andygrove opened on Oct 14, 2026

• AQE: split SelectJoinRule::optimize into per-action methods and flatten its nesting

  enhancementhelp wantedrusttech debt
  apache/datafusion-ballista#2601 · Filter by author andygrove opened on Oct 14, 2026

• Share the binding driver between bind_task_bias and bind_task_round_robin

  enhancementhelp wantedrusttech debt
  apache/datafusion-ballista#2600 · Filter by author andygrove opened on Oct 14, 2026
  1

• Extract shared execute/handoff logic from the three shuffle writer execs

  enhancementhelp wantedrusttech debt
  apache/datafusion-ballista#2599 · Filter by author andygrove opened on Oct 14, 2026

• Deduplicate execute_query_pull and execute_query_push in DistributedQueryExec

  enhancementhelp wantedrusttech debt
  apache/datafusion-ballista#2598 · Filter by author andygrove opened on Oct 14, 2026
  1

• Break start_executor_process_inner into startup phases

  enhancementhelp wantedrusttech debt
  apache/datafusion-ballista#2597 · Filter by author andygrove opened on Oct 14, 2026

• Split QueryStageScheduler::on_receive into per-event handlers

  enhancementhelp wantedrusttech debt
  apache/datafusion-ballista#2596 · Filter by author andygrove opened on Oct 14, 2026

• [EPIC] Share execution graph logic between StaticExecutionGraph and AdaptiveExecutionGraph

  enhancementhelp wantedrusttech debt
  apache/datafusion-ballista#2595 · Filter by author andygrove opened on Oct 14, 2026
  1

• AQE: resolve_stage and rollback_*_stage drop the stage from the graph when the conversion fails

  bugcorrectnesshelp wantedrusttech debt
  apache/datafusion-ballista#2594 · Filter by author andygrove opened on Oct 14, 2026
  1

  

• Executor never honours scheduler_connect_timeout_seconds and retries the scheduler connection forever

  bughelp wantedrusttech debt
  apache/datafusion-ballista#2593 · Filter by author andygrove opened on Oct 14, 2026

• [EPIC] Support Hive tables for users migrating from Spark

  enhancement
  apache/datafusion-ballista#2580 · Filter by author andygrove opened on Oct 10, 2026

• perf: hybrid sort-shuffle buffering: split rows by partition on arrival when memory allows

  apache/datafusion-ballista#2578 · Filter by author NoahKusaba opened on Oct 10, 2026
  4

• Discover Hive partitions like Spark: allow partition columns stored in the files, and infer their types

  enhancement
  apache/datafusion-ballista#2555 · Filter by author andygrove opened on Oct 7, 2026

• Job hangs after losing one executor with AQE: stale tasks can't be cancelled in pull-staged mode, then "Can't find active stage to update stage outputs"

  apache/datafusion-ballista#2539 · Filter by author andygrove opened on Oct 4, 2026

• Executor keeps a session's first S3 settings after SET s3.* changes them

  bug
  apache/datafusion-ballista#2533 · Filter by author andygrove opened on Oct 4, 2026

• Proposal: pluggable S3 credential providers

  enhancement
  apache/datafusion-ballista#2532 · Filter by author andygrove opened on Oct 4, 2026
  

• Adopt DataFusion MemoryDriftTracker after upgrading DataFusion

  apache/datafusion-ballista#2531 · Filter by author andygrove opened on Oct 3, 2026

• Support rolling upgrades without an outage window

  enhancement
  apache/datafusion-ballista#2525 · Filter by author andygrove opened on Oct 2, 2026
  1

• Performance review: shuffle, executor, scheduler and client findings (tracking)

  apache/datafusion-ballista#2520 · Filter by author NoahKusaba opened on Oct 1, 2026
  2

  

• perf: shuffle writers use one blocking thread per output partition and compress outside the vcore budget

  apache/datafusion-ballista#2509 · Filter by author NoahKusaba opened on Sep 29, 2026
  1

  

• Discussion: move the expensive CI jobs to a merge queue, like Comet

  development-process
  apache/datafusion-ballista#2500 · Filter by author andygrove opened on Sep 27, 2026