v0.14.2

What's Changed

Feature

• [Webhook]: Redesign deployments webhook for better user experience #3408
• [Config-UI]: Show task names for DORA plugin in Blueprint #3446
• [TAPD]: Support issue type and status mapping #3389

BugFix

• [DORA]: Fix pull_requests table missing deploy_time #3399
• [DORA]: Fix production environment scope error #3444
• [Starrocks]: Fix data type mapping between postgresql and starrocks #3436

Full Changelog: v0.14.1...v0.14.2

v0.14.1

What's Changed

This release contains some minor bug fixes for v0.14.0.

• fix: bitbucket generated wrong clone url (#3315)
• fix: forward original status code and body (#3342)
• fix: filter status by connection

Full Changelog: v0.14.0...v0.14.1

v0.14.0

What's Changed

• [Feature] Ship DORA Stage 1 - Introduce DORA metrics to Apache DevLake #2853. See demo: https://grafana-lake.demo.devlake.io/grafana/d/qNo8_0M4z/dora
• [Feature] Add deployment webhook to integrate deployments from unsupported CI/CD tools #3023
• [Feature] Introduce a customize plugin to add fields in domain layer schema, define standard issue statuses, etc. #2802 #2535
• [Feature] Allow users to identify scrum and non-scrum board in Jira #2801
• [Feature] Config-ui: Supports db migration confirmation #2788
• Other small features, bug-fixes and doc updates

New Contributors

• @zhangzhenyu2 made their first contribution in #2896
• @lshmouse made their first contribution in #2970
• @nicoabie made their first contribution in #2946
• @jltaglia made their first contribution in #2927
• @mintsweet made their first contribution in #2995

Full Changelog: v0.13.0...v0.14.0

v0.13.0

What's Changed

• [feat-1681][jira]: Collect the epic issue in an issue's epic link by @keon94 in #2401
• feat: add DirectoryOrCreate in k8s-deploy.yaml by @ppborah in #2625
• feat: project_mapping for org plugin by @mindlesscloud in #2616
• [issue-2632] Casting error in FolderInput node struct by @keon94 in #2634
• refactor: align helm chart with docker-compose by @matrixji in #2643
• fix: jira connection is deleted when enckey is error by @abeizn in #2648
• fix: github.ExtractApiPullRequestReviews panic by @mindlesscloud in #2655
• fix: add NoPKModel to commit_parents by @mindlesscloud in #2654
• fix: patch /blueprints/:id wouldn't handle byte[] by @klesh in #2660
• [feat-2433]: record execution time for plugin subtasks by @keon94 in #2455
• fix: fix walk fields not filter struct by @mappjzc in #2661
• fix config-ui: blueprints service pack 2.0 by @e2corporation in #2630
• fix: rename pull_request_number to pull_request_key, issue_number to … by @mindlesscloud in #2635
• fix: pack swagger doc into docker images by @klesh in #2657
• fix the worklog collecting taking too long by @mindlesscloud in #2662
• feat: github add cicd feature by @abeizn in #2651
• feat: gitlab-ci by @mappjzc in #2633
• feat(jenkins): collect more fields by @warren830 in #2638
• feat(domain layer): add cicd entities by @warren830 in #2667
• feat: add jira swagger by @warren830 in #2669
• feat: add community experience dashboard by @hezyin in #2636
• feat: github cicd enricher from run to pipeline by @abeizn in #2685
• feat: github cicd enricher from run to pipeline by @abeizn in #2686
• feat(jenkins): add jenkins pipeline convertor by @warren830 in #2683
• fix: cached plan must not change result type by @abeizn in #2687
• feat: github cicd convertor by @abeizn in #2689
• Feat stages convertor by @warren830 in #2690
• feat: gitlab job convert by @mappjzc in #2682
• fix: devlake_blueprints settings does exist by @abeizn in #2696
• feat(jenkins): add swagger by @warren830 in #2700
• feat: add github connection swaggger by @abeizn in #2703
• docs: swagger support for github plugin by @mappjzc in #2704
• fix: jira changelog.FromValue & changelog.ToValue by @mindlesscloud in #2692
• docs(tapd): add swagger by @warren830 in #2702
• fix: index.jsx typo by @ppborah in #2695
• feat(frontend): add tapd config-ui by @warren830 in #2675
• API /version returning @ in docker mode by @klesh in #2711
• fix(plugins): add response body to status=200 in swagger by @warren830 in #2716
• feat: add before_action and after_action for blueprint by @likyh in #2644
• docs: swagger for feishu by @mappjzc in #2710
• docs: swagger for gitee by @abeizn in #2717
• feat(gitlab): add projects api by @warren830 in #2705
• Remove useless fields and fix typo (related to #2706) by @klesh in #2719
• fix: add quote in starrocks create table sql to prevent keyword conflict by @long2ice in #2725
• docs(project): add (incubating) by @warren830 in #2731
• fix: github/gitlab should pass down proxy setting to gitext by @klesh in #2737
• feat: api to get pipeline list of blueprints by blueprint_id by @abeizn in #2722
• Table info by @mappjzc in #2720
• fix bug #2550 by @jinzhu2002 in #2587
• docs(plugins): add fake api to describe specific-plugin blueprint and… by @warren830 in #2739
• feat(plugins): add swagger for special plugins by @warren830 in #2740
• feat: github,gitlab,gitee blueprint and pipelines swagger by @abeizn in #2746
• feat: add a plugin bitbucket by @thenicetgp in #2458
• [refactor-2134]: Add more context to Backend error messages by @keon94 in #2745
• feat: add header for svg by @likyh in #2738
• fix: starrocks plugin double precision convert by @long2ice in #2751
• fix: support multi type of story point field by @narrowizard in #2754
• fix: add getAfterResponse to overwrite by helper by @likyh in #2755
• feat config-ui: blueprint settings management (edit blueprint) by @e2corporation in #2659
• fix(jenkins): fix has stages by @warren830 in #2733
• fix(framework): update code generator templates by @warren830 in #2641
• fix(framework): modify swagger by @warren830 in #2759
• fix: fix Jira adding connection bug by @mindlesscloud in #2748
• perf: added error handling missing code by @Pranshu-Raj in #2562
• fix(tapd): modify changelog by @warren830 in #2758
• [refactor-2688] Uplift Golang version by @keon94 in #2694
• Feat: add azure devops by @warren830 in #2631
• feat: graphql POC in github by @likyh in #2619
• feat: add the link to Grafana guide in dashboards by @Startrekzky in #2771
• [feat-2578]: Download pipeline logging archives API by @keon94 in #2656
• docs: fix the wrong comma by @Startrekzky in #2773
• Feat add jenkins repo mapping by @warren830 in #2769
• info api and domain layer info by @mappjzc in #2761
• feat: add be_host and fix hash columns by @long2ice in #2774
• fix: issue_number does not exist by @abeizn in #2777
• feat: add github pr-body transform field by @e2corporation in #2772
• fix: starrocks import data error by @long2ice in #2779
• fix: use camel-case props for adv json samples by @e2corporation in #2782
• feat: add connection rate limit setting by @e2corporation in #2783
• fix: issue_number does not exist by @abeizn in #2787
• fix: fix for ci by @likyh in #2770
• refactor: active connections - use rateLimitPerHour property by @e2corporation in #2796
• fix: github since parameter does not work by @abeizn in #2803
• fix: fetch proxy only if jira is an enabled provider by @e2corporation in #2795
• fix(tapd): modify story bug because of new api by @warren830 in #2794
• fix: do not pre-select active entity in create-mode by @e2corporation in #2799
• fix: some issues can not bind pull_request in pr_issue_enricher by @abeizn in #2807
• fix: delete ...

v0.12.0

Breaking Changes

• MultiConnection was added to all our data-source plugins, all collected data will be wiped during the upgrade in order to ensure data integrity. #636 #1978 #2262
• pipeline.tasks was renamed to pipeline.plan #1951
• pipeline.plan[][].options.tasks was moved to pipeline.plan[][].subtasks #1412
• Separated Data Transformation Rules from Connection and bound to Scope #1548
• Introduced Dal interface for Database decoupling (deprecating *gorm.DB dependency) #2183
• All connection.rate_limit were renamed to connection.rate_limit_per_hour #2360
• All *users tables were renamed to *accounts, and the users table in Domain Layer is now representing Unique Identity #2431

Features

• New User Flow based on Blueprint #1951 #1979 #1980 #1981 #1982 #1986 #1987 #2468 #2472
• Team feature support #2361 #2426 #2427 #2428 #2429 #2430 #2431 #2477
• Support collecting pr/issue comments from Github / Gitlab #1746, #1758, #1760
• Automatic test including unit-test/e2e-test #1754 #1765 #2491 #1824 #1851 #1853
• New Dashboard "Community Overview" and other dashboard updates #1995 #2323 #2328
• Support collecting data from Jenkins Folders #2145
• Skip HTTPS certificate verification #2370
• Separated Github Tokens #2384 #2423
• Collect organization information for Github users #2408
• Skip collecting changelog for epic issues to reduce total time #2434
• Acquire user's consent before db migration #2440
• Collect Github comments/reviews #2452
• Throttling total number of pipelines running in parallel #2473

Others

• Remove outdated field for Jira plugin #1711
• Release scheduler #1772
• Total number of fixed bugs: 43
• Total number of commits: 359
• Files changed: 1288

New Contributors

• @SnowMoon-Dev made their first contribution in #2074
• @moonlzl made their first contribution in #2221
• @long2ice made their first contribution in #2200
• @marcemv90 made their first contribution in #2238
• @krshkodes made their first contribution in #2388
• @yumengwang03 made their first contribution in #2479
• @phzbbbbbbbb made their first contribution in #2492
• @Pranshu-Raj made their first contribution in #2488

Full Changelog: v0.11.0...v0.12.0

v0.11.0

Changelogs:

• Support Postgres
• Support collecting private git repos
• Improve unit test
• Redesign and implement configuration flow

v0.10.1

v0.10.1 is a minor release on top of v0.10.0 with mostly dashboard/docs updates.

Major Changes since Last Release (v0.10.0)

• Support incremental collection for Jira worklog
• Add a dashboard for weekly bug retro use case (grafana/WeeklyBugRetro.json)
• Add a generic Jenkins dashboard (grafana/Jenkins.json)
• Improve the Github basic metrics dashboard (grafana/GithubBasicMetrics.json)
• Update dashboards according to the latest domain layer schema
• Adopt a new file name convention to shorten file names
• Add docs for the advanced mode of Config UI

Full Changelog: v0.10.0...v0.10.1

v0.10.0

Major Changes since Last Release (v0.9.3)

• Pipeline Blueprint allows users to schedule recurring pipelines with cron expression
• Introduce DB migrations to DevLake to provide a smoother upgrade experience
• Add temporal mode for users with heavy data collection workload
• Add dbt plugin for users who want to define their own data transformations
• Store/cache API responses from data sources in the raw data layer for instant replay of data transformations

Full Changelog: v0.9.3...v0.10.0

Bug Fixes & Improvements since Last Beta Release (v0.10.0-beta1)

• Improve documentation for user setup and GitHub data collection process
• Fix incorrect created_date in domain layer
• Fix stuck pipelines due to retries
• Add users for plugin Jira

Full Changelog: v0.10.0-beta1...v0.10.0

New Contributors

• @liangjingyang made their first contribution in https://github.com/merico-dev/lake/pull/377
• @nitinvasanth made their first contribution in https://github.com/merico-dev/lake/pull/526
• @IronCore864 made their first contribution in https://github.com/merico-dev/lake/pull/747
• @ggcannard made their first contribution in https://github.com/merico-dev/lake/pull/752
• @MaximDub made their first contribution in https://github.com/merico-dev/lake/pull/885
• @Juneezee made their first contribution in https://github.com/merico-dev/lake/pull/1013
• @basicthinker made their first contribution in https://github.com/merico-dev/lake/pull/1178
• @daniel-hutao made their first contribution in https://github.com/merico-dev/lake/pull/1193
• @abeizn made their first contribution in https://github.com/merico-dev/lake/pull/1343

v0.10.0-beta1

Major Changes since Last Release (v0.9.3)

• Pipeline Blueprint allows users to schedule recurring pipelines with cron expression
• Introduce DB migrations to DevLake to provide a smoother upgrade experience
• Add temporal mode for users with heavy data collection workload
• Add dbt plugin for users who want to define their own data transformations
• Store/cache API responses from data sources in the raw data layer for instant replay of data transformations

Full Changelog: v0.9.3...v0.10.0-beta1

New Contributors

• @liangjingyang made their first contribution in https://github.com/merico-dev/lake/pull/377
• @nitinvasanth made their first contribution in https://github.com/merico-dev/lake/pull/526
• @IronCore864 made their first contribution in https://github.com/merico-dev/lake/pull/747
• @ggcannard made their first contribution in https://github.com/merico-dev/lake/pull/752
• @MaximDub made their first contribution in https://github.com/merico-dev/lake/pull/885
• @Juneezee made their first contribution in https://github.com/merico-dev/lake/pull/1013
• @basicthinker made their first contribution in https://github.com/merico-dev/lake/pull/1178
• @daniel-hutao made their first contribution in https://github.com/merico-dev/lake/pull/1193
• @abeizn made their first contribution in https://github.com/merico-dev/lake/pull/1343

v0.9.3

Fixed issues found in v0.9.2

1. gitlab api client reporting nil pointer #1450
2. gitlab commits collection not working #1459
3. mysql reporting unexpected EOF due to some operation would hold cursor for a long time #1452
4. convert gitlab_merge_request_commits to domain layer data pull_request_commits #1470