Skip to content

chore: migrate Tinybird workspace from Classic to Forward - #68

Closed
VinneyJ wants to merge 35 commits into
chore/sync-upstream-aug-2026from
chore/tinybird-cfa-config
Closed

chore: migrate Tinybird workspace from Classic to Forward#68
VinneyJ wants to merge 35 commits into
chore/sync-upstream-aug-2026from
chore/tinybird-cfa-config

Conversation

@VinneyJ

@VinneyJ VinneyJ commented Jul 28, 2026

Copy link
Copy Markdown

Summary

  • Migrates CFA's Tinybird workspace from Classic to Forward (required before Tinybird's Classic sunset on September 15, 2026)
  • Adds tinybird.config.json required by Tinybird Forward
  • Pulls v2 endpoint pipe definitions and materializations from Classic workspace
  • Adds TYPE endpoint to v4 analytics pipes so Forward exposes them as HTTP endpoints
  • Removes FORWARD_QUERY blocks after migration completed (they were one-time migration artifacts)
  • Moves v4 pipes back to pipes/ to match upstream structure

Why this is separate from the upstream sync

This is a CFA infrastructure change, not an upstream code change. Upstream manages their own Tinybird workspace separately and is unaffected by this.

Test plan

thepsalmist and others added 30 commits September 11, 2025 15:10
@thepsalmist
rm apps/web/vercel.json file since cron jobs are not required for the…
b9e7c55 
… self-hosted version
@thepsalmist
setup tnybird
6682c3f
@thepsalmist
Fix build type errors
d76d493
@thepsalmist
Add custom domain
78623fe
@thepsalmist
Fix type builderrors
242897a
@thepsalmist
Update DefaultDomain
7ab9c8d
@thepsalmist
Revert DefaultDomains model
1b42581
@thepsalmist
Add custom default domain
9e25042
@thepsalmist
Update domain
45925be
@thepsalmist
Update domain
68ff90d
@thepsalmist
Update default domain
5abac33
@thepsalmist
Update DefaultDomains
6802e6b
@thepsalmist
Update set AWS region
dcf4e5a
@thepsalmist
Update Resend email configs
fa68f0b
@kilemensi
Make ReSend from and replyTo ENV configurable
b24c2a0
@kilemensi
Merge branch 'main' into chore-resend_from_reply_envs
12cd565
@kilemensi
Missing new line
a0d241c
@kilemensi
Merge pull request #5 from CodeForAfrica/chore-resend_from_reply_envs
0e87135 
Enable ENV configuration for Resend from and replyTo dubinc#2906
@thepsalmist
Update - Disable SignUps and redirect /register to /login
7f00779
@thepsalmist
Merge branch 'main' of github.com:CodeForAfrica/dub
e5655ea
@thepsalmist
Merge branch 'main' of github.com:CodeForAfrica/dub
7fd227d
@thepsalmist
Update docs to include self-hosting guide
f3aa53a
@thepsalmist
Merge branch 'main' into develop
44b32f7
@thepsalmist
Update self-hosting docs
90360a9
@VinneyJ
Merge remote-tracking branch 'upstream/main' into sync-upstream-devel…
a56fb8f 
…op-2026-07-16

# Conflicts:
#	apps/web/app/(ee)/api/events/export/route.ts
#	apps/web/app/(ee)/api/events/route.ts
#	apps/web/next.config.js
#	packages/email/src/resend/constants.ts
#	packages/email/src/send-via-resend.ts
#	pnpm-lock.yaml
@VinneyJ
Fix missing ResendBulkEmailOptions import from merge
7d02181 
Left out of the import when resolving the merge conflict in
packages/email/src/send-via-resend.ts; caught by tsc --noEmit.
@VinneyJ
chore: resolve merge conflicts with main (fast-xml-parser version)
6e49efd
@VinneyJ
Add CFA hostnames to APP_HOSTNAMES so middleware routes them to app
f97b055
@VinneyJ
Make session cookie domain configurable via NEXTAUTH_COOKIE_DOMAIN en…
efd9b4f 
…v var
@VinneyJ
Migrate Tinybird workspace from Classic to Forward
4513d7f 
- Add FORWARD_QUERY directives to datasources with schema changes
  (dub_click_events, dub_sale_events, dub_lead_events,
   dub_api_logs, dub_links_metadata)
- Add partner_tag_ids to dub_links_metadata_pipe explicit column list
- Add dub_regular_links_metadata_latest datasource and materialization
- Add v2 endpoint pipes from Classic workspace (endpoints/ directory)
- Add tinybird.config.json for Forward workspace configuration
- Add backup script for pre-migration data export
@vercel

vercel Bot commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
dub Error Error Aug 3, 2026 3:32pm

Request Review

VinneyJ added a commit that referenced this pull request Jul 28, 2026
@VinneyJ
Revert Tinybird Forward migration commits (moved to PR #68)
d03cf63
@kilemensi
kilemensi changed the base branch from main to chore/sync-upstream-jul-2026 July 29, 2026 08:42
@kilemensi
kilemensi changed the base branch from chore/sync-upstream-jul-2026 to main July 29, 2026 08:43
@kilemensi
kilemensi changed the base branch from main to chore/sync-upstream-jul-2026 July 29, 2026 11:05
@VinneyJ

VinneyJ commented Aug 3, 2026

Copy link
Copy Markdown
Author

These folders do not represent a divergence from upstream. Here is the breakdown:

endpoints/ and materializations/ are official, first-class folders in Tinybird Forward’s project structure, as documented by Tinybird. They are absent from dubinc/dub because upstream has not migrated to Forward yet and is still using Classic. Once upstream migrates, it will use the same folder structure.

More importantly, the 18 v2 pipes in endpoints/ and the dub_regular_links_metadata_pipe materialization are not new resources. They have been live in CfA’s production Tinybird workspace since September 2025. This PR brings the Git repository in sync with what is already deployed. It does not introduce new infrastructure.

tinybird.config.json is required for tb --cloud deploy to work in Forward mode. Without it, the CLI cannot interact with the workspace.

The scripts/ folder is being removed from this PR because it contains shell utility scripts that are not part of the Tinybird workspace configuration.

@VinneyJ VinneyJ mentioned this pull request Aug 13, 2026
Merged
@VinneyJ
VinneyJ changed the base branch from chore/sync-upstream-jul-2026 to chore/sync-upstream-aug-2026 August 13, 2026 10:09
@VinneyJ

VinneyJ commented Aug 13, 2026

Copy link
Copy Markdown
Author

Closing in favour of #71 — rebuilt cleanly off the upstream sync branch (PR #70) with only packages/tinybird/ changes. Xavier's CFA customizations will be carried forward in the CFA customizations PR.

@VinneyJ VinneyJ closed this Aug 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@VinneyJ @thepsalmist @kilemensi