Skip to content

Commit

Permalink
Private Datasets: use SQLite storage by default for multi-tenant (#787)
Browse files Browse the repository at this point in the history
* kamu-cli: a SQLite database is used for a multi-tenant workspace

* kamu-cli, prepare_run_dir(): move error variables into format string

* kamu-cli, run(): use database_config

* InitCommand::before_run(): absorb checks

* kamu-cli, run(): apply embedded migrations

* SqlitePlugin::open_sqlite_pool(): add the "create if missing" flag

* kamu-cli, apply_migrations(): use warn!() not panic!()

* kamu-cli, build.rs: rebuild if ./migrations/ changed

* CHANGELOG.md: update

* CHANGELOG.md: fix typo

* kamu-cli, run(): remove an outdated TODO

* CHANGELOG.md: update after rebase

* kamu-cli, command_needs_transaction(): apply for "add"

* kamu-cli, initialize_components(): FlowServiceImpl pre-initialization

* TODO DROP: OutboxTransactionalProcessor::run_with_mode(): introduce

* PropertyName::dataset_allows_anonymous_read(): parity with dataset_allows_public_read()

* CHANGELOG.md: update

* kamu-cli, build.rs: rebuilt if migration have changed

* kamu-cli, build.rs: activate "fail on error" for vergen

* kamu-cli, build.rs: add a comment about vergen

* DatabaseConfig::sqlite_database() -> sqlite_database_in_workspace_dir()

* SqlitePlugin::catalog_with_connected_pool(): absorb the migrator stuff

* async-utils: introduce

* Creating a database in a temporary directory with subsequent moving

* kamu-cli: remove extra dep

* WebUIServer: typo fixes

* kamu-cli, initialize_components(): rename to initialize_server_components()

* Fixes after rebasing

* kamu-cli, configure_base_catalog(): remove unused "is_e2e_testing" argument

* kamu-cli: introduce server_catalog

* kamu-cli, configure_server_catalog(): move login-related deps to the base catalog

* kamu-cli, get_command(): rename cli_catalog -> work_catalog

* test_di_server_graph_validates(): add

* test_di_cli_graph_validates(): remove extra components

* test_di_graph: split st & mt test variants

* test_di_graph: fix lint warnings

* Fixes after rebasing

* kamu-cli, List command: fix a typo

* OutboxExecutor::run_while_has_tasks(): introduce

* kamu-cli: restore app.rs changes

* kamu-cli: get_app_database_config(): move to database.rs

* Extract fix of the WebUIFeatureFlags' typo into a dedicated issue

* AppDatabaseConfig: logic simplification

* kamu-cli, app: initialize_base_components(): extract

* kamu-cli, app: initialize_server_components(): debug logging instrumentation

* kamu-cli, app: move_initial_database_to_workspace_if_needed(): extract

* kamu-cli, app: initialize_server_components(): absorb APIServerRunCommand::pre_run()

* Updates after rebasing

* Release (minor): 0.204.0
  • Loading branch information
s373r authored Sep 25, 2024
1 parent 35241b4 commit 4b06ccf
Show file tree
Hide file tree
Showing 25 changed files with 907 additions and 433 deletions.
9 changes: 8 additions & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,13 @@ Recommendation: for ease of reading, use the following order:
- Fixed
-->

## [0.204.0] - 2024-09-25
### Changed
- If not explicitly configured, a SQLite database is used for a multi-tenant workspace
- If a SQLite database is used, built-in migrations are automatically applied
- Start processing added Outbox messages after successful command execution
- DI: `ServerCatalog` added, to split dependencies

## [0.203.1] - 2024-09-24
### Added
- Added database migration & scripting to create an application user with restricted permissions
Expand Down Expand Up @@ -167,7 +174,7 @@ Recommendation: for ease of reading, use the following order:
### Changed
- Upgraded `sqlx` crate to v0.8
- Renamed `setConfigSchedule` GQL api to `setConfigIngest`. Also extended
`setConfigIngest` with new field `fetchUncacheable` which indicates to ingone cache
`setConfigIngest` with new field `fetchUncacheable` which indicates to ignore cache
during ingest step

## [0.195.1] - 2024-08-16
Expand Down
Loading

0 comments on commit 4b06ccf

Please sign in to comment.