Cascading @cascading

Need support or guidance? Reach out to @cwensel https://t.co/5YnPV67z39 cascading.wensel.net Joined November 2010

Tweets

779
Followers

2K
Following

10
Likes

7

Cascading @cascading

a year ago

Cascading 4.5.2 is out! github.com/cwensel/cascad… central.sonatype.com/artifact/net.w…

0 1 1 83 0

Do you miss meetups of the Big Data era, when you could learn about RAFT protocol or map-side join over pizza and beer? Us too! My friend @cwensel has launched SF Distributed Systems Meetup. First meetup is next week, with talks by me and @conor_power23 lu.ma/t6r4mi4v

2 11 34 12K 8

Cascading @cascading

2 years ago

If your company is still running Cascading+HadoopMR applications and are itching to drop MR for Spark, dm me. Some companies have 100s of @cascading apps in production and moving them off MR in a couple lines of code would be a huge cost savings. Also true for @scalding.

0 1 0 119 0

Joe Hellerstein @joe_hellerstein

2 years ago

I always suspected that Parquet and Orc weren't very good, but TIL from @ViktorLeis that one can do much much better with BtrBlocks. cs.cit.tum.de/fileadmin/w00c…

8 16 137 73K 127

Chris K Wensel @[email protected] @cwensel

2 years ago

Cascading 4.5.1 was just released to Maven Central. buff.ly/3YgQHyh This release includes minor bug fixes and dependency updates. buff.ly/45qUnAf

0 1 0 127 0

Julian Hyde @julianhyde

3 years ago

@fuyufjh @andy_pavlo @ApacheCalcite @luciddb @iskyzh @ApacheHive Before I worked at Hortonworks putting Calcite in Hive, I worked on Lingual, a SQL interface to @cascading. That was the first commercial use of Calcite (then called Optiq) and some much needed consulting $$

1 2 7 384 0

Chris K Wensel @[email protected] @cwensel

3 years ago

I'm hanging my shingle out again. I have some new insights I want time to work out into a developer tool for cloud data engineers, but I want to bootstrap it with contract/consulting revenue. This is how I started @cascading in 2007. chris.wensel.net Please boost!

0 3 1 289 0

P. Oscar Boykin @posco

3 years ago

Scala folks: if there are open source GitHub Twitter libraries you like, you might want to make a clone/fork now. Seems like we are in a situation where anything can happen.

3 22 85 0 1

Cascading @cascading

3 years ago

#MyTwitterAnniversary

0 0 2 0 0

Download Image

Chris K Wensel @[email protected] @cwensel

3 years ago

really interested in adding mergeable summary as a datatype to @cascading. think having daily/hourly aggregate tables, then daily/hourly performing a last N day/hour aggregation against the partials. cost efficient way to have rolling percentiles/aggregates

1 1 1 0 0

Cascading @cascading

3 years ago

Cascading 4.5 is out! With native @ApacheParquet, @apachekafka, @neo4j, and @splunk support. - cascading.wensel.net - github.com/cwensel/cascad… - groups.google.com/g/cascading-us…

0 1 3 0 0

Chris K Wensel @[email protected] @cwensel

3 years ago

cross your fingers, we might have a @cascading 4.1 release tonight, and a quick 4.5 release a day later w/ Hadoop 3 support. Both will include native @ApacheParquet support to replace the support dropped by Parquet. Plus some well worn enhanced Parquet support in 4.6

0 1 7 0 0

Chris K Wensel @[email protected] @cwensel

3 years ago

For fun I really want to fork the @cascading local mode planner to support RocksDB as the backend for joins instead of the memory only hashmaps. Local mode was never intended to scale in joins.

0 1 2 0 0

Cascading @cascading

3 years ago

Cascading 4.1 is out! With native @ApacheParquet, @apachekafka, @neo4j, and @splunk support. - github.com/cwensel/cascad… - groups.google.com/g/cascading-us…

0 1 0 0 0

Chris K Wensel @[email protected] @cwensel

4 years ago

finally @cascading has Apache Hadoop 3 (and Tez 0.10) support thanks to the team at @Foursquare Labs! github.com/cwensel/cascad…

0 1 1 0 0

Julian Hyde @julianhyde

4 years ago

Gradle makes me feel stupid

4 3 18 0 0

Steve Loughran [email protected] @steveloughran

4 years ago

@cwensel @PinterestEng Google gs connector does do aligned block reads...both that and this one work well for backwards seeks (footers, stripe footers -> stripes) /2

1 2 0 0 0

Chris K Wensel @[email protected] @cwensel

4 years ago

Improving efficiency and reducing runtime using S3 read optimization by @PinterestEng link.medium.com/KGRST76OBjb << do you have a link to the git repo?