Chronos is probably overkill for what I am looking to do with time series data. I just did an Ask HN on time series[0] but unfortunately didn't get the replies I was hoping for. Maybe this thread can get the bump I need:
I inherited a large time series JSON dataset in 2024. I've been successful in using the Observable Framework[1] by writing a Rust (rust-script) data loader[2] to parse and plot simple line charts[3] to visually see the data. There are hundreds of graphs over years of data so I would like to identify what graphs I should be paying attention to. My initial thought is to calculate metrics on each graph such as:
- Variability: how "spread out" are the data points from one another?
- Trend: direction of data path, up or down?
- Slope: are the data points increasing or decreasing?
- Level: where are the data points on the vertical axis?
What libraries, AI, databases, etc... would you recommend that would allow me to calculate these values? I am no data scientist and don't need forecasting but overall, I just want a dashboard that shows the most "important" graphs.
I always worked in R for time series analysis. This cookbook has everything you would need for a plan to analyze a time series [0] and this book provides a strong base and understanding while being focus on forecasting. [1] Have fun !
When you ask what data should be paying attention to, that should be depends on your objective. Do you want to predict something? Identify anomalies? In the end, what matters is understanding the meaning and relations of these data, rather than throwing them in to some ML framework and hoping to get something out.
Prediction and anomalies are not objectives but of the 4 listed, I would say the primary objective is identifying a trend in the data to know whether the data is moving in a specific direction—increasing or decreasing in value.
I already added linear regression marks that draws linear regression lines with confidence bands[1] to my Observable plots but they do not give me a “value” so I need to manually look at the graphs and read the red line.
I inherited a large time series JSON dataset in 2024. I've been successful in using the Observable Framework[1] by writing a Rust (rust-script) data loader[2] to parse and plot simple line charts[3] to visually see the data. There are hundreds of graphs over years of data so I would like to identify what graphs I should be paying attention to. My initial thought is to calculate metrics on each graph such as:
What libraries, AI, databases, etc... would you recommend that would allow me to calculate these values? I am no data scientist and don't need forecasting but overall, I just want a dashboard that shows the most "important" graphs.[1] https://observablehq.com/framework/
[2] https://observablehq.com/framework/loaders
[3] https://observablehq.com/@observablehq/plot-simple-line-char...
edit: the x-axis is Time while the y-axis can be values such as duration, frequency, intervals
[0] https://news.ycombinator.com/item?id=39763246