Introduction: Apache Dolphin Scheduler has recently ushered the official release of version 3.0.0-beta-1. The new version mainly fixes code and documentation for 3.0.0-alpha, and introduces some features such as support for FlinkSQL task types, new Zeppelin task types, new Kubernetes namespace management features, passing references via bash, etc. See below for details.

01 New Features

• Support for the FlinkSQL task type

In this release, we have extended the Flink task type to support running Flink SQL tasks, which are submitted using sql-client.sh.

For more details see.
flink sql client](https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sqlclient/)

Corresponds to PR: 9840
link
https://github.com/apache/dolphinscheduler/pull/9840

• New Zeppelin task type

In this version, we have added the Zeppelin task type for creating and executing Zeppelin type tasks.When Worker executes this type of tasks it will trigger a Zeppelin Notebook segment via the Zeppelin Cient API.

PR: 9810
[Link].
https://github.com/apache/dolphinscheduler/pull/9810

• New Kubernetes namespace management

This release adds Kubernetes namespace management functionality, allowing users to manage Kubernetes namespaces in Apache DolphinScheduler.

PR: 9303
[Link].
https://github.com/apache/dolphinscheduler/pull/9303

• Local parameters can be fetched via shell component now

The new version also allows users to pass parameters via bash. If you want to use bash variables in downstream tasks instead of constant value export parameters, you can do this via setValue and Bash variables, which are more flexible and allow you to dynamically fetch existing local or HTTP resources to get set variables.

A similar syntax can be used.

lines_num=$(wget https://raw.githubusercontent.com/apache/dolphinscheduler/dev/README.md -q -O - | wc -l | xargs)echo "#{setValue(set_val_ var=${lines_num})}"

PR: 9586
[Link].
https://github.com/apache/dolphinscheduler/pull/9586

• Allow users to upload files without a suffix

Previously the Resource Centre could only upload files with a suffix, after version 3.0.0-beta-1 we support users uploading files without a suffix.

02 Bug Fix

• 3.0.0-alpha issues with various deployment methods
• Error on page when task group is empty
• Problem with treemap view depth error
• Unclear alert messages: unclear error message when alert group is empty, unclear error message when batch delete workflow has exceptions, long error message when tenant content is wrong, delete
• Parameter verification problem: Data source centre parameter verification problem, password inconsistency prompt when changing password, alert script verification before sending alerts
• Python api: can't set release state problem, local parameter has value but checksum fails problem
• token query does not follow the time zone issue
• Fix HTTPS and HTTP string recognition problem.
• Fix alert server health monitoring failure.
• Repair the condition task branch failure problem.
• Repair the problem that docker images do not support multiple platforms.
• Fix the problem that the database is not written correctly when creating workflows with task group priority
• Fix the failure of master task.
• Fix serial wait not running issue
• Time zone issue: scheduling time zone error issue, add time zone support to logs
• Failure to re-run and suspend workflow instances
• Resource Centre instantiation failure issue

03 Documentation changes

• Correction of deployment documentation
• Fixed and updated some documentation: WebexTeams Chinese documentation, local and global parameters documentation, Kubernetes FAQ documentation, Spark notes documentation, DataX usage documentation, removed Flink API documentation, fixed open-api error, fixed data quality error documentation; added stand-alone documentation on switching databases; new documentation on determining the running state of Yarn in the shell; newly updated system screenshots
• Corrected some development documentation: clarified supported operating systems, fixed development environment build documentation, added documentation for building docker image

04 Specific changes

All changes can be found at: https://github.com/apache/dolphinscheduler/releases/tag/3.0.0-beta-1.

05 Thanks to the contributors of version 3.0.0-beta-1

Amy0104, BaoLiang, caishunfeng, calvin, chuxing, czeming, Dannila, Devosend, Eric Gao, exmy, gaojun2048, guoshupei, HeChuan, hstdream, jiachuan. zhu, Jiajie Zhong, JinYong Li, Kerwin, kezhenxu94, labbomb, leiwingqueen, lidongdai, litiliu, LongJGun, longtb, Lyle Shaw, mans2singh, mazhong, Mr. An, naziD, nobleD, Mr. Dannila, Devosend, Eric Gao, exmy, gaojun2048, guoshupei, HeChuan, hstdream, jiachuan. An, naziD, nobolity, Paul Zhang, PJ Fanning, qianli2022, QuakeWang, rockfang, songjianet, sparklezzz, sq-q, Town, Tq, WangJPLeo, wangyang, worry, wqxs, xiangzihao, yimaixinchen, youzipi, zhuxt2015, zixi0825, Chen Jiaming, Chen Shuang, WangYang

Join the Community

There are many ways to participate and contribute to the DolphinScheduler community, including:

Documents, translation, Q&A, tests, codes, articles, keynote speeches, etc.

We assume the first PR (document, code) to contribute to be simple and should be used to familiarize yourself with the submission process and community collaboration style.

So the community has compiled the following list of issues suitable for novices: https://github.com/apache/dolphinscheduler/issues/5689

List of non-newbie issues: https://github.com/apache/dolphinscheduler/issues?q=is%3Aopen+is%3Aissue+label%3A%22volunteer+wanted%22

How to participate in the contribution: https://dolphinscheduler.apache.org/en-us/community/development/contribute.html

GitHub Code Repository: https://github.com/apache/dolphinscheduler

Official Website：https://dolphinscheduler.apache.org/

MailList：dev@dolphinscheduler@apache.org

Twitter：@dolphinschedule

YouTube：https://www.youtube.com/channel/UCmrPmeE7dVqo8DYhSLHa0vA

Slack：https://s.apache.org/dolphinscheduler-slack

Contributor Guide：https://dolphinscheduler.apache.org/en-us/community/index.html

Your Star for the project is important, don’t hesitate to lighten a Star for Apache DolphinScheduler ❤️