collapse @collapse_R

A C/C++ based package for advanced data transformation and statisical computing in R. Account managed by the author. #rcollapse sebkrantz.github.io/collapse/ CRAN and Github Joined June 2020

Tweets

190
Followers

975
Following

29
Likes

82

collapse @collapse_R

7 months ago

{collapse} 2.1.0 is out! It introduces a new fslice() function (sebkrantz.github.io/collapse/refer…), a new theory-consistent weighted quantile algorithm (sebkrantz.github.io/collapse/refer…) with excellent properties. And some convenience features such as join requirements: #rstats #DataScience

1 9 49 2K 11

Download Image

collapse @collapse_R

8 months ago

The {collapse} arXiv paper has just been updated - following extensive revision: arxiv.org/abs/2403.05038. I believe it is a great resource for anyone doing scientific computing with #rstats.

0 7 20 1K 13

collapse @collapse_R

8 months ago

There is now a #fastverse benchmark wiki (github.com/fastverse/fast…) where users can freely contribute benchmarks. If you have benchmarks involving {fastverse} packages ({collapse}, {data.table}, etc., including extensions) please contribute them (takes 1 min) #rstats #DataScience

0 1 15 497 5

Data Table @r_data_table

a year ago

Check out the latest package to be granted the Seal of Approval: {collapse} by Sebastian Krantz! {collapse} is a partner package, that implements various data transformation and statistical analysis tasks using ultra fast C/C++ implementations. rdatatable-community.github.io/The-Raft/posts…

3 8 75 8K 25

collapse @collapse_R

a year ago

{collapse} v2.0.15, with fast aggregation pivots, has just reached CRAN. A minor but neat feature worth pointing out in this release is enhanced join verbosity. In addition to the join success rates, the join relationship is now determined and reported - at no extra cost #rstats

0 7 39 3K 15

Download Image

collapse @collapse_R

a year ago

New independent benchmark by Adrian Antico: github.com/AdrianAntico/B… Setup: - large local Windows machine - real data - broad range of tasks - scripts executed inside Rstudio and VScode -> shows that {collapse} is an absolute top performer in this setting #rstats #DataScience

0 5 24 6K 14

collapse @collapse_R

a year ago

{collapse} v2.0.15, already available via install.packages("collapse", repos = "fastverse.r-universe.dev"), adds wide/recast pivot()'s with aggregation, including some hard-coded internal functions. A game changer for pivot tables in R. More at sebkrantz.github.io/collapse/refer…. #rstats

2 7 57 7K 24

Download Image

collapse @collapse_R

2 years ago

An article on {collapse} is available on arXiv: arxiv.org/abs/2403.05038 (submitted to Journal of Statistical Software). It highlights the aims and added value of collapse and its cutting-edge performance for many complex statistical tasks in #rstats. Please consider sharing it.

1 9 58 7K 21

collapse @collapse_R

2 years ago

{collapse} has been benchmarked in the DuckDB benchmark: duckdblabs.github.io/db-benchmark/, and is pretty competitive on 0.5-5Gb (laptop-grade) operations. A surprise is that it seems to be the only framework next to DuckDB to be able perform large data joins (50Gb) efficiently. #rstats

2 5 61 8K 7

collapse @collapse_R

2 years ago

I’m thrilled to announce the release of {collapse} 2.0, adding blazing fast joins, pivots, a flexible namespace, and many other features. It is a remarkable piece of R software and capable of enhancing the workflow of all R users. Spread the word #rstats sebkrantz.github.io/Rblog/2023/10/…

0 31 157 29K 64

collapse @collapse_R

2 years ago

As I'm slowly moving towards the release of collapse 2.0, you have again opportunities to explore features in the development version and provide valuable feedback (API, performance, bugs etc.). In particular join() and pivot() are major innovations and likely of interest.

7 9 73 7K 11

Download Image

collapse @collapse_R

2 years ago

Released a minor update {collapse} v1.9.6, which, notably, includes a new vignette on how {collapse} handles R objects - a quick view behind the scenes of its class-agnostic R programming framework: sebkrantz.github.io/collapse/artic… #rcollapse #rstats

0 0 6 843 1

collapse @collapse_R

3 years ago

{collapse} v1.9.5 is released - with a limited set of SIMD instructions. As of last week, collapse has been downloaded 1 million times from CRAN. I thus wrote a post reflecting on the past, present state and future of #rcollapse and #fastverse in #rstats: sebkrantz.github.io/Rblog/2023/04/…

2 6 26 5K 4

collapse @collapse_R

3 years ago

I've created a small video tutorial about the new global argument default settings and OpenMP multithreading in {collapse}: youtube.com/watch?v=ne4Es2… #rstats #rcollapse #fastverse

1 2 9 2K 0

collapse @collapse_R

3 years ago

Released a C/C++ patch (v1.9.2), which includes a noteworthy addition: function set_collapse(nthreads = [int], na.rm = [TRUE|FALSE]) can be used to globally set argument defaults. This is worthwhile on larger projects (e.g. M1 Mac + 4 threads = >10Gb's data crunching). #rstats

0 3 13 3K 3

Download Image

collapse @collapse_R

3 years ago

#rcollapse 1.9 has been released to CRAN, providing greater performance and versatility in almost every domain, alongside new functionality such as grouped & weighted sample quantiles (in C) pushing the frontiers of #rstats. News: sebkrantz.github.io/collapse/news/… #fastverse #DataScience

0 4 31 9K 5

collapse @collapse_R

3 years ago

#fastverse v0.3.0 is out, lighter than before, with an ability to install development versions from r-universe. The README (github.com/fastverse/fast…) was updated to reflect the state of high-performance in R. Those leaving twitter can also follow fosstodon.org/@sebkrantz #RStats