vilhess commited on
Commit
de43bca
·
verified ·
1 Parent(s): 0d3a8c4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -15
README.md CHANGED
@@ -1,3 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  tags:
3
  - timeseries
@@ -13,21 +26,6 @@ This model has been pushed to the Hub using the [PytorchModelHubMixin](https://h
13
  - Code: [GitHub](https://github.com/vilhess/PatchFM)
14
  - Paper: Incoming
15
 
16
- # A tutorial on how to build a Foundation Model for Univariate Time Series Forecasting
17
-
18
- [Huggingface Model Card](https://huggingface.co/vilhess/PatchFM)
19
-
20
- A concise, reproducible recipe for training a transformer-based, patch-to-patch forecasting model for univariate time series. The approach mirrors Large Language Model (LLM) practices (next-token → next-patch) while remaining lightweight compared to a classic LLM and practical.
21
-
22
- ## Highlights
23
- - Next-patch prediction objective (autoregressive, causal)
24
- - Patch-based representation of time series (tokens ↔ patches)
25
- - Causal masking self-attention with RoPE (relative positions)
26
- - RevIN (Reversible Instance Normalization) with causal statistics
27
- - SwiGLU feed-forward networks
28
- - Multi-quantile outputs (median + uncertainty bands)
29
- - Efficient rollout with KV caching
30
-
31
  ## Installation
32
  ```bash
33
  git clone https://github.com/vilhess/PatchFM
 
1
+ # A tutorial on how to build a Foundation Model for Univariate Time Series Forecasting
2
+
3
+ A concise, reproducible recipe for training a transformer-based, patch-to-patch forecasting model for univariate time series. The approach mirrors Large Language Model (LLM) practices (next-token → next-patch) while remaining lightweight compared to a classic LLM and practical.
4
+
5
+ ## Highlights
6
+ - Next-patch prediction objective (autoregressive, causal)
7
+ - Patch-based representation of time series (tokens ↔ patches)
8
+ - Causal masking self-attention with RoPE (relative positions)
9
+ - RevIN (Reversible Instance Normalization) with causal statistics
10
+ - SwiGLU feed-forward networks
11
+ - Multi-quantile outputs (median + uncertainty bands)
12
+ - Efficient rollout with KV caching
13
+
14
  ---
15
  tags:
16
  - timeseries
 
26
  - Code: [GitHub](https://github.com/vilhess/PatchFM)
27
  - Paper: Incoming
28
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  ## Installation
30
  ```bash
31
  git clone https://github.com/vilhess/PatchFM