profile
viewpoint
Michael G. Noll miguno Europe https://www.michael-noll.com/ Ex Office of the CTO at @confluentinc (Apache Kafka), formerly product manager of ksqlDB & Kafka Streams. Open source committer. Writer.

miguno/kafka-storm-starter 725

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

miguno/avro-cli-examples 129

Examples on how to use the command line tools in Avro Tools to read and write Avro files

miguno/avro-hadoop-starter 112

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

miguno/akka-mock-scheduler 86

A mock Akka scheduler to simplify testing scheduler-dependent code

miguno/puppet-kafka 42

Wirbelsturm-compatible Puppet module to deploy Kafka 0.8+ clusters

miguno/golang-docker-build-tutorial 39

A template project to create a minimal Docker image for a Go application

miguno/gradle-testng-mockito-bootstrap 33

A ready-to-use bootstrap Java project backed by gradle, TestNG, Mockito, FEST-Assert 2 and Cobertura for Eclipse and IntelliJ IDEA, with support for Jenkins CI.

miguno/kafka-avro-codec 19

Avro encoder/decoder for use as serializer.class in Apache Kafka 0.8

miguno/graphite-supervisord-rpm 17

How to install and configure Graphite 0.9.x via RPMs on RHEL 6 and run it under process supervision with supervisord.

miguno/java-docker-build-tutorial 13

A template project to create a minimal Docker image for a Java application

startedimbateam-gg/awesome-bw-dev

started time in a day

issue commentdocker/hub-feedback

Detailed download statistics per image

Yes, it would still be great if this could be solved.

michaelcoburn

comment created time in 5 days

issue closedmiguno/avro-cli-examples

Avro on textfiles

Thanks for the great examples. I am struggling doing exactly the same using (zipped) csv files (using | as a delimiter), fromtext option and a schema file. Could you possibly add an example like this?

I would be willing to contribute if you could guide me to some blog, specification/documentation where I can read about this. Currently I only found Michael Noll's blog going into some detail.

Thanks a lot! Best, Christoph

closed time in 5 days

chaosmail

issue closedmiguno/avro-cli-examples

Any idea how to get around the colon bug of avro cli

When running avro cli as such: java -jar avro-tools-1.7.7.jar tojson /path/to/my:file.avro

I get the following error:

Exception in thread "main" java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI:

Is there a workaround to this bug other than renaming files ?

closed time in 5 days

George3d6

issue commentmiguno/avro-cli-examples

Any idea how to get around the colon bug of avro cli

I am not aware of any workaround other than renaming files.

George3d6

comment created time in 5 days

push eventmiguno/avro-cli-examples

Michael G. Noll

commit sha e59508d91d17d124314b4e87831cd649f8ed19ef

Upgrade to Avro 1.11.0

view details

push time in 5 days

push eventmiguno/avro-cli-examples

Michael G. Noll

commit sha b1ecc07efe78c324f1ffecda52d5a6b2df4b5fb8

Upgrade to Avro 1.11.0

view details

push time in 5 days

push eventmiguno/avro-cli-examples

Michael G. Noll

commit sha ad51e3e96a0d116e02d737e929e5d305fd9143aa

Upgrade to Avro 1.11.0

view details

push time in 5 days

push eventmiguno/avro-cli-examples

Michael G. Noll

commit sha 8d4df9938d24c78f2e16529dea027915d53093b3

Upgrade to Avro 1.11.0

view details

push time in 5 days

push eventmiguno/avro-cli-examples

Michael G. Noll

commit sha a70a2a5c2c83b41325ef1e5fe8dcb3f64b616e07

Docs

view details

push time in 5 days

startedCaldis/Mos

started time in a month

fork miguno/Sabaki

An elegant Go board and SGF editor for a more civilized age.

https://sabaki.yichuanshen.de/

fork in a month

startedBotspot/pi-apps

started time in 2 months

PR opened confluentinc/event-streaming-patterns

Use responseEvent to configure response

Fixes what likely was a copy-paste error when the pattern description was written.

Original bug report at https://forum.confluent.io/t/how-do-correlation-identifiers-work/2864/2.

+2 -2

0 comment

1 changed file

pr created time in 2 months

push eventconfluentinc/event-streaming-patterns

Michael G. Noll

commit sha 476bc6000ad6a63f7169e4b949fe331a9d2f16e7

Use responseEvent to configure response

view details

push time in 2 months

create barnchconfluentinc/event-streaming-patterns

branch : correlation-identifier-fix

created branch time in 2 months

Pull request review commentapache/kafka-site

Added select KS APAC & EU 2021 videos

 <h4 class="anchor-heading">       </h4>        <ul>+        <li>+          <a target="_blank" href="https://www.confluent.io/events/kafka-summit-apac-2021/should-you-read-kafka-as-a-stream-or-in-batch-should-you-even-care/">Should You Read Kafka as a Stream or in Batch? Should You Even Care?</a>,+          Ido Nadler (Nielsen) &amp; Opher Dubrovsky (Nielsen) +        </li>+        <li>+          <a target="_blank" href="https://www.confluent.io/events/kafka-summit-apac-2021/scaling-a-core-banking-engine-using-apache-kafka/">Scaling a Core Banking Engine Using Apache Kafka</a>,+          Peter Dudbridge (Thought Machine)

Lacks conference info (which summit?)

bellemare

comment created time in 3 months

Pull request review commentapache/kafka-site

Added select KS APAC & EU 2021 videos

 <h4 class="anchor-heading">       </h4>        <ul>+        <li>+          <a target="_blank" href="https://www.confluent.io/events/kafka-summit-europe-2021/making-kafka-cloud-native/">Making Kafka Cloud Native</a>,+          Jay Kreps (Confluent), KS EU 2021+        </li>+        <li>+          <a target="_blank" href="https://www.confluent.io/events/kafka-summit-europe-2021/how-ksqldb-works/">How ksqlDB works</a>,+          Michael Drogalis (Confluent) , KS EU 2021
          Michael Drogalis (Confluent), KS EU 2021
bellemare

comment created time in 3 months

PullRequestReviewEvent
PullRequestReviewEvent
more