profile
viewpoint
If you are wondering where the data of this site comes from, please visit https://api.github.com/users/zhongjiajie/events. GitMemory does not store any data, but only uses NGINX to cache data for a period of time. The idea behind GitMemory is simply to give users a better reading experience.
Jiajie Zhong zhongjiajie Guangzhou, China http://zhongjiajie.com Data engineer, committer @apache Airflow

zhongjiajie/Autohome 23

Using Scrapy to crawl Autohome, storage into MonogDB, simple analysis and NLP coming soon

zhongjiajie/beauty 20

美女图片,不一样的套图体验,55156图库-高清套图非官方API

zhongjiajie/zhongjiajie.github.com 10

My github page and wiki

zhongjiajie/mysql_schedule_backup 8

schedule backup MySQL database.

zhongjiajie/DataX 6

基于alibaba/DataX修改的一个fork

zhongjiajie/airflow 2

Apache Airflow

zhongjiajie/docker-airflow 2

Docker Apache Airflow

zhongjiajie/wallpaper 1

桌面图片下载器,下载Social Wallpapering的图片

zhongjiajie/airflow-doc-zh 0

:book: [译] Airflow 中文文档

zhongjiajie/cpython 0

The Python programming language

push eventzhongjiajie/dolphinscheduler

Jiajie Zhong

commit sha f0ffe1b13762840787bda3804b381695e10d6d94

Add ASF license

view details

Jiajie Zhong

commit sha 177b0cddb206151f65d8af0970be9bf11e6830d7

Remove unused module

view details

Jiajie Zhong

commit sha 59cceba776c2b44434915d408ffe9dccfe590fda

Add content to readme

view details

push time in 10 hours

push eventzhongjiajie/dolphinscheduler

Jiajie Zhong

commit sha bebbd0d1a287e796d329d733ddfd3962268f79c9

Init DS python SDK pydolphinscheduler: python code definition

view details

push time in 11 hours

PR opened apache/dolphinscheduler

Init DS python SDK pydolphinscheduler

Purpose of the pull request

First commit and init for pydolphinscheduler

Brief change log

Initialization pydolphinscheduler, a python sdk for DolphinScheduler which could define workflow by code

Verify this pull request

<!--(Please pick either of the following options)-->

This pull request is code cleanup without any test coverage.

(or)

This pull request is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

<!--(example:)

  • Added dolphinscheduler-dao tests for end-to-end.
  • Added CronUtilsTest to verify the change.
  • Manually verified the change by testing locally. -->
+1041 -0

0 comment

39 changed files

pr created time in 11 hours

create barnchzhongjiajie/dolphinscheduler

branch : init-pyds

created branch time in 11 hours

pull request commentapache/dolphinscheduler

Fix StandaloneServer start with error

But when I add guava to task shell module, standalone work again

zhongjiajie

comment created time in 11 hours

pull request commentapache/dolphinscheduler

Fix StandaloneServer start with error

Hi @kezhenxu94, I update the description and error log in issue #6265

And for the questions

can you figure out why guava is not brought into the standalone module? It should be there as well

I don't know why

zhongjiajie

comment created time in 11 hours

pull request commentapache/dolphinscheduler

Fix StandaloneServer start with error

@CalvinKirs PTAL, Thx.

zhongjiajie

comment created time in 12 hours

PR opened apache/dolphinscheduler

Fix StandaloneServer start with error

Start standalone server with error NoClassDefFoundError

closes: https://github.com/apache/dolphinscheduler/issues/6265

Purpose of the pull request

Start standalone server with error NoClassDefFoundError

closes: https://github.com/apache/dolphinscheduler/issues/6265

Brief change log

Fix StandaloneServer class no found error when start server in IDEA

Verify this pull request

+5 -0

0 comment

1 changed file

pr created time in 12 hours

create barnchzhongjiajie/dolphinscheduler

branch : dev-standalone-class-not-found

created branch time in 12 hours

issue openedapache/dolphinscheduler

[Bug] [standalone] Error when start standalone cause `NoClassDefFoundError`

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

When I start standalone dev env in my IDEA with dolphinscheduler-standalone-server/src/main/java/org/apache/dolphinscheduler/server/StandaloneServer.java. It crash with error

org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'workerServer': Invocation of init method failed; nested exception is java.lang.NoClassDefFoundError: com/google/common/collect/ImmutableList
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:139)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:413)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1761)
	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:335) ~[na:1.8.0_231]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:592)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:514)
	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:321)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:319)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:439) ~[na:1.8.0_231]
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
	at org.apache.dolphinscheduler.server.master.processor.queue.StateEventResponseService$StateEventResponseWorker.run(StateEventResponseService.java:112) ~[classes/:na]

What you expected to happen

It should work when I run standalone server

How to reproduce

Just rebuild your mevan deps, and runs dolphinscheduler-standalone-server/src/main/java/org/apache/dolphinscheduler/server/StandaloneServer.java in your IDEA

Anything else

No response

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

created time in 12 hours

delete branch zhongjiajie/sqlfluff

delete branch : ci-rm-unneed

delete time in 3 days

pull request commentsqlfluff/sqlfluff

Remove unused deps in tox test docbuild

The results show that requirements.txt and requirements_dev.txt are not run.

I found out after you said, my initial think job docbuild had parent dependent https://github.com/sqlfluff/sqlfluff/blob/845c8eb3bb8d5c31a90c0d9c626c59834b92040e/tox.ini#L9-L21 So it only need to add docs/requirements.txt for addition https://github.com/sqlfluff/sqlfluff/blob/845c8eb3bb8d5c31a90c0d9c626c59834b92040e/tox.ini#L87-L89

but after you said and I checkout the CI logs, and doc build just install dependent docs/requirements.txt and work fine https://github.com/sqlfluff/sqlfluff/pull/1406/checks?check_run_id=3605563486#step:5:8 I make me surprised too.

zhongjiajie

comment created time in 3 days

pull request commentsqlfluff/sqlfluff

Add README on how to generate docs

Good job!

tunetheweb

comment created time in 3 days

pull request commentsqlfluff/sqlfluff

Remove unused deps in tox test docbuild

Ref PR https://github.com/sqlfluff/sqlfluff/pull/1393

zhongjiajie

comment created time in 4 days

Pull request review commentsqlfluff/sqlfluff

Add README on how to generate docs

+# SQLFluff - Generating the document website++You can run the following steps to generate the documentation website:++```+tox -e docbuild, doclint+```++The `docbuild` job will recognise when source files have changed and only+generate the changed files. To force a clean build (for example when changing+config) rather than the source files use the following command from the project+root directory (drop the `-C doc` if running from within the `docs` directory).++```+make -C doc clean
make -C docs clean
tunetheweb

comment created time in 4 days

Pull request review commentsqlfluff/sqlfluff

Add README on how to generate docs

+# SQLFluff - Generating the document website++You can run the following steps to generate the documentation website:++```+tox -e docbuild, doclint+```++The `docbuild` job will recognise when source files have changed and only+generate the changed files. To force a clean build (for example when changing+config) rather than the source files use the following command from the project+root directory (drop the `-C doc` if running from within the `docs` directory).++```+make -C doc clean+```++The built HTML should be placed in `docs/build/html` and can be opened directly+in the browser or you can launch a simple webserver with the below command+and then navigate to http://127.0.0.1:8000/ to view the site locally:++```+python -m http.server --directory docs/build/html+```++Again, this command is run from the root server, not the `doc` subfolder but you
Again, this command is run from the root server, not the `docs` subfolder but you
tunetheweb

comment created time in 4 days

Pull request review commentsqlfluff/sqlfluff

Add README on how to generate docs

+# SQLFluff - Generating the document website++You can run the following steps to generate the documentation website:++```+tox -e docbuild, doclint+```++The `docbuild` job will recognise when source files have changed and only+generate the changed files. To force a clean build (for example when changing+config) rather than the source files use the following command from the project+root directory (drop the `-C doc` if running from within the `docs` directory).++```+make -C doc clean+```++The built HTML should be placed in `docs/build/html` and can be opened directly+in the browser or you can launch a simple webserver with the below command+and then navigate to http://127.0.0.1:8000/ to view the site locally:++```+python -m http.server --directory docs/build/html+```++Again, this command is run from the root server, not the `doc` subfolder but you+can alter the path as appropriate if needs be.++If you don't want to use `tox`, then you can complete the steps manually with+the following commands after setting up your Python environment as detailed+in the [CONTRIBUTING.md](../CONTRIBUTING.md) file.++```+cd docs+pip install -r requirements.txt+make html+python -m http.server --directory build/html+```++Or alternatively from the root folder:++```+pip install -r docs/requirements.txt+make -C docs html+python -m http.server --directory docs/build/html+```++The docs use Sphinx and are generated from the source code.+The config is available in `docs/src/conf.py`.
The config is available in `docs/source/conf.py`.
tunetheweb

comment created time in 4 days

Pull request review commentsqlfluff/sqlfluff

Add README on how to generate docs

 larger changes or giving the green light to major structural project changes.  ## Nerdy Details++### Developing and Running SQLFluff Locally++To use your local development branch of SQLFluff, I recommend you use a virtual+environment. e.g:++```shell+python3 -m venv .venv+source .venv/bin/activate+```+> `python3 -m venv .venv` creates a new virtual environment (in current working

> `python3 -m venv .venv` creates a new virtual environment (in current working
tunetheweb

comment created time in 4 days

PullRequestReviewEvent

Pull request review commentsqlfluff/sqlfluff

Add README on how to generate docs

+# SQLFluff - Generating the document website++You can run the following steps to generate the documentation website:++```+tox -e docbuild, doclint+```++The `docbuild` job will recognise when source files have changed and only+generate the changed files. To force a clean build (for example when changing+config) rather than the source files use the following command from the project+root directory (drop the `-C doc` if running from within the `docs` directory).
root directory (drop the `-C docs` if running from within the `docs` directory).
tunetheweb

comment created time in 4 days

PullRequestReviewEvent

push eventzhongjiajie/sqlfluff

Jiajie Zhong

commit sha af2ab867f3988c91d762f054c1265d8ae1439c54

Revert testing case

view details

push time in 4 days

pull request commentsqlfluff/sqlfluff

Remove unused deps in tox test docbuild

As the result show on CI result, we don't need reinstall dependent requirements.txt and requirements_dev.txt in job docbuild could in already install in [testenv]

So I think we could remove code in https://github.com/sqlfluff/sqlfluff/pull/1406/files#diff-ef2cef9f88b4fe09ca3082140e67f5ad34fb65fb6e228f119d3812261ae51449L89-L90

zhongjiajie

comment created time in 4 days

PR opened sqlfluff/sqlfluff

Remove unused deps in tox test docbuild

Brief summary of the change made

ATT, remove unused deps in tox job

+0 -4

0 comment

2 changed files

pr created time in 4 days

create barnchzhongjiajie/sqlfluff

branch : ci-rm-unneed

created branch time in 4 days

pull request commentsqlfluff/sqlfluff

Fix documentation SQL highlight error

Thanks for reviewing and merging.

zhongjiajie

comment created time in 4 days

delete branch zhongjiajie/sqlfluff

delete branch : doc-sql-highlight

delete time in 4 days

pull request commentsqlfluff/sqlfluff

Fix documentation SQL highlight error

It would be nice to try to figure out why the ultimate_replacements don't work. Seems like useful functionality. But that's separate to this PR.

I inspect and found out it only work for code, but we try to make it work with code syntax .. code-block:: sql, so it did not work in our case

zhongjiajie

comment created time in 4 days

push eventzhongjiajie/sqlfluff

Jiajie Zhong

commit sha 4e3a784c8658d0f65e20e875839bd2ecc64266d7

Revert "Fix linting" This reverts commit b116adc2

view details

Jiajie Zhong

commit sha fea7056f39d5cf55571610fa598665964a870029

Revert "Add/change variables" This reverts commit 4814a2f1

view details

Jiajie Zhong

commit sha 2bd33027d1263e80ed190359f5bf286a64e9be9a

Revert "Set :force: options for all sql code block" This reverts commit e94c179b

view details

push time in 4 days

push eventzhongjiajie/sqlfluff

Jiajie Zhong

commit sha 89fd851de748945d39a71783e7a0e9ef831c885e

Revert "Revert "Fix doc rule ref sql doc highlight error"" This reverts commit 794ceffd

view details

push time in 4 days