PostgreSQL pgBackRest + Prophet Forecast + Prometheus Grafana & Auto-Tuning

Job Overview

Budget

$1,200.00

Level

Senior

Location

Italy

Job Posted

26 Sep, 2025

Category

backup

Total Proposals

0

Job Description

Data-Science Angle (Unique Structure)

You are Head of Data Infrastructure at a IoT analytics company. pgBackRest backups spike IOPS at fixed 6 h intervals—correlating with user query latency jumps. You want an AI-driven scheduler that predicts low-traffic windows and self-tunes backup start-time daily—no human calendar.

AI-Driven Outcomes

  • Backup start-time moves daily ±90 min based on traffic forecast.
  • Predictive R² ≥ 0.85 on CPU & IOPS time-series.
  • Grafana anomaly alert if actual vs forecast >15 %.

ML-Ops Scope I Will Deliver

  • Time-Series Data Pipeline
    • Prometheus metrics : pg_stat_activity, node_cpu, node_disk_io_now.
    • 3-month historical CSV export (1 min granularity).
  • Prophet Forecast Model
    • Python notebook (Prophet) → hourly predictions 7 days ahead.
    • Hyper-parameter tuning : changepoint_prior_scale, seasonality_mode.
  • Auto-Scheduler Micro-Service
    • FastAPI service deployed on EKS → exposes /next-backup-window API.
    • CronJob calls API daily 01:00 UTC → returns optimal start-time (±90 min).
  • pgBackRest Integration
    • Dynamic cron entry template (Jinja2) → start-time injected daily.
    • pgBackRest config stanza with compression zstd + parallel 4
  • Observability & Feedback Loop
    • Grafana dashboard : forecast vs actual CPU (overlay).
    • Alertmanager : anomaly >15 % → Slack #data-ops
  • Model Retraining Pipeline
    • GitHub Actions weekly → retrain model + push new container (Seldon).

 AI-Ops Deliverables

  • Prophet notebook (ipynb) + requirements.txt.
  • FastAPI Dockerfile + Helm chart + Prometheus ServiceMonitor.
  • Grafana dashboard JSON + Alertmanager YAML.
  • CSV accuracy report : MAE, RMSE, R².

Why Only a Senior ML-Infra Engineer

  • Prophet contributor + Prometheus maintainer experience.
  • Carried 2 IoT unicorns through AI-driven scheduling; IOPS −42 %.
  • 30-day model drift monitoring included (shared Slack).

Skills

  • Backup schedules and retention policies

Tags

Backup schedules and retention policies

Author Spotlight

Isabella Ferrari

Isabella Ferrari

Client

No description available.

Related Jobs

1 year ago Senior
$70.00 Hourly

We are hiring a Business Continuity Planner to develop a comprehensive strategy for maintaining operations during disrup...

Risk assessment and analysis
View More
1 year ago MidLevel
$65.00 Hourly

We are looking for a Backup Automation Specialist to automate and optimize our data backup processes. This role involves...

Backup automation for different backup types (e.g., file backup, database backup, application backup)
View More
1 year ago MidLevel
$60.00 Hourly

We are seeking a Data Recovery Expert to implement and manage data recovery solutions, ensuring data can be restored eff...

Data recovery tools and technologies
View More
1 year ago MidLevel
$60.00 Hourly

We are hiring a Backup Security Analyst to secure our backup systems, ensuring data integrity and protection against ran...

Backup data encryption
View More
Isabella Ferrari

Isabella Ferrari

Italy


Member Since
Oct 26, 2024
Total Created Jobs
8