xgboost: Extreme Gradient Boosting

Extreme Gradient Boosting, which is an efficient implementation of the gradient boosting framework from Chen & Guestrin (2016) <doi:10.1145/2939672.2939785>. This package is its R interface. The package includes efficient linear model solver and tree learning algorithms. The package can automatically do parallel computation on a single machine which could be more than 10 times faster than existing gradient boosting packages. It supports various objective functions, including regression, classification and ranking. The package is made to be extensible, so that users are also allowed to define their own objectives easily.

Install the latest version of this package by entering the following in R:
install.packages("xgboost")
AuthorTianqi Chen <tianqi.tchen@gmail.com>, Tong He <hetong007@gmail.com>, Michael Benesty <michael@benesty.fr>, Vadim Khotilovich <khotilovich@gmail.com>, Yuan Tang <terrytangyuan@gmail.com>
Date of publication2017-01-05 10:40:06
MaintainerTong He <hetong007@gmail.com>
LicenseApache License (== 2.0) | file LICENSE
Version0.6-4
https://github.com/dmlc/xgboost

View on CRAN

Man pages

agaricus.test: Test part from Mushroom Data Set

agaricus.train: Training part from Mushroom Data Set

callbacks: Callback closures for booster training.

cb.cv.predict: Callback closure for returning cross-validation based...

cb.early.stop: Callback closure to activate the early stopping.

cb.evaluation.log: Callback closure for logging the evaluation history

cb.print.evaluation: Callback closure for printing the result of evaluation

cb.reset.parameters: Callback closure for restetting the booster's parameters at...

cb.save.model: Callback closure for saving a model file.

dimnames.xgb.DMatrix: Handling of column names of 'xgb.DMatrix'

dim.xgb.DMatrix: Dimensions of xgb.DMatrix

getinfo: Get information of an xgb.DMatrix object

predict.xgb.Booster: Predict method for eXtreme Gradient Boosting model

print.xgb.Booster: Print xgb.Booster

print.xgb.cv: Print xgb.cv result

print.xgb.DMatrix: Print xgb.DMatrix

setinfo: Set information of an xgb.DMatrix object

slice.xgb.DMatrix: Get a new DMatrix containing the specified rows of orginal...

xgb.attr: Accessors for serializable attributes of a model.

xgb.create.features: Create new features from a previously learned model

xgb.cv: Cross Validation

xgb.DMatrix: Contruct xgb.DMatrix object

xgb.DMatrix.save: Save xgb.DMatrix object to binary file

xgb.dump: Save xgboost model to text file

xgb.importance: Show importance of features in a model

xgb.load: Load xgboost model from binary file

xgb.model.dt.tree: Parse a boosted tree model text dump

xgboost-deprecated: Deprecation notices.

xgb.parameters: Accessors for model parameters.

xgb.plot.deepness: Plot model trees deepness

xgb.plot.importance: Plot feature importance as a bar graph

xgb.plot.multi.trees: Project all trees on one tree and plot it

xgb.plot.tree: Plot a boosted tree model

xgb.save: Save xgboost model to binary file

xgb.save.raw: Save xgboost model to R's raw vector, user can call xgb.load...

xgb.train: eXtreme Gradient Boosting Training

Functions

agaricus.test Man page
agaricus.train Man page
callbacks Man page
cb.cv.predict Man page
cb.early.stop Man page
cb.evaluation.log Man page
cb.print.evaluation Man page
cb.reset.parameters Man page
cb.save.model Man page
dimnames<-.xgb.DMatrix Man page
dimnames.xgb.DMatrix Man page
dim.xgb.DMatrix Man page
getinfo Man page
getinfo.xgb.DMatrix Man page
predict.xgb.Booster Man page
predict.xgb.Booster.handle Man page
print.xgb.Booster Man page
print.xgb.cv.synchronous Man page
print.xgb.DMatrix Man page
setinfo Man page
setinfo.xgb.DMatrix Man page
slice Man page
slice.xgb.DMatrix Man page
xgb.attr Man page
xgb.attr<- Man page
xgb.attributes Man page
xgb.attributes<- Man page
xgb.create.features Man page
xgb.cv Man page
[.xgb.DMatrix Man page
xgb.DMatrix Man page
xgb.DMatrix.save Man page
xgb.dump Man page
xgb.ggplot.deepness Man page
xgb.ggplot.importance Man page
xgb.importance Man page
xgb.load Man page
xgb.model.dt.tree Man page
xgboost Man page
xgboost-deprecated Man page
xgb.parameters<- Man page
xgb.plot.deepness Man page
xgb.plot.importance Man page
xgb.plot.multi.trees Man page
xgb.plot.tree Man page
xgb.save Man page
xgb.save.raw Man page
xgb.train Man page

Files

inst
inst/doc
inst/doc/xgboost.Rnw
inst/doc/xgboost.R
inst/doc/xgboostPresentation.Rmd
inst/doc/discoverYourData.R
inst/doc/discoverYourData.Rmd
inst/doc/discoverYourData.html
inst/doc/xgboostPresentation.R
inst/doc/xgboostPresentation.html
inst/doc/xgboost.pdf
configure.ac
tests
tests/testthat.R
tests/testthat
tests/testthat/test_callbacks.R tests/testthat/test_parameter_exposure.R tests/testthat/test_glm.R tests/testthat/test_lint.R tests/testthat/test_monotone.R tests/testthat/test_poisson_regression.R tests/testthat/test_dmatrix.R tests/testthat/test_update.R tests/testthat/test_basic.R tests/testthat/test_helpers.R tests/testthat/test_custom_objective.R tests/testthat/test_gc_safety.R
src
src/src
src/src/c_api
src/src/c_api/c_api.cc
src/src/c_api/c_api_error.cc
src/src/c_api/c_api_error.h
src/src/objective
src/src/objective/multiclass_obj.cc
src/src/objective/rank_obj.cc
src/src/objective/regression_obj.cc
src/src/objective/objective.cc
src/src/metric
src/src/metric/elementwise_metric.cc
src/src/metric/multiclass_metric.cc
src/src/metric/metric.cc
src/src/metric/rank_metric.cc
src/src/learner.cc
src/src/cli_main.cc
src/src/data
src/src/data/sparse_page_dmatrix.cc
src/src/data/sparse_page_source.cc
src/src/data/sparse_page_raw_format.cc
src/src/data/sparse_batch_page.h
src/src/data/sparse_page_source.h
src/src/data/sparse_page_dmatrix.h
src/src/data/simple_csr_source.h
src/src/data/sparse_page_writer.cc
src/src/data/data.cc
src/src/data/simple_dmatrix.h
src/src/data/simple_dmatrix.cc
src/src/data/simple_csr_source.cc
src/src/common
src/src/common/common.h
src/src/common/base64.h
src/src/common/random.h
src/src/common/config.h
src/src/common/common.cc
src/src/common/math.h
src/src/common/bitmap.h
src/src/common/sync.h
src/src/common/thread_local.h
src/src/common/io.h
src/src/common/group_data.h
src/src/common/quantile.h
src/src/gbm
src/src/gbm/gbm.cc
src/src/gbm/gblinear.cc
src/src/gbm/gbtree.cc
src/src/tree
src/src/tree/updater_histmaker.cc
src/src/tree/updater_colmaker.cc
src/src/tree/updater_skmaker.cc
src/src/tree/tree_model.cc
src/src/tree/updater_sync.cc
src/src/tree/updater_refresh.cc
src/src/tree/tree_updater.cc
src/src/tree/updater_prune.cc
src/src/tree/param.h
src/src/tree/updater_basemaker-inl.h
src/src/logging.cc
src/dmlc-core
src/dmlc-core/src
src/dmlc-core/src/io.cc
src/dmlc-core/src/io
src/dmlc-core/src/io/s3_filesys.h
src/dmlc-core/src/io/hdfs_filesys.h
src/dmlc-core/src/io/line_split.h
src/dmlc-core/src/io/recordio_split.cc
src/dmlc-core/src/io/uri_spec.h
src/dmlc-core/src/io/filesys.h
src/dmlc-core/src/io/hdfs_filesys.cc
src/dmlc-core/src/io/local_filesys.cc
src/dmlc-core/src/io/single_file_split.h
src/dmlc-core/src/io/input_split_base.cc
src/dmlc-core/src/io/local_filesys.h
src/dmlc-core/src/io/azure_filesys.h
src/dmlc-core/src/io/line_split.cc
src/dmlc-core/src/io/s3_filesys.cc
src/dmlc-core/src/io/input_split_base.h
src/dmlc-core/src/io/recordio_split.h
src/dmlc-core/src/io/azure_filesys.cc
src/dmlc-core/src/io/cached_input_split.h
src/dmlc-core/src/io/threaded_input_split.h
src/dmlc-core/src/config.cc
src/dmlc-core/src/data
src/dmlc-core/src/data/parser.h
src/dmlc-core/src/data/basic_row_iter.h
src/dmlc-core/src/data/row_block.h
src/dmlc-core/src/data/strtonum.h
src/dmlc-core/src/data/libsvm_parser.h
src/dmlc-core/src/data/csv_parser.h
src/dmlc-core/src/data/disk_row_iter.h
src/dmlc-core/src/data/text_parser.h
src/dmlc-core/src/recordio.cc
src/dmlc-core/src/data.cc
src/dmlc-core/include
src/dmlc-core/include/dmlc
src/dmlc-core/include/dmlc/json.h
src/dmlc-core/include/dmlc/any.h
src/dmlc-core/include/dmlc/array_view.h
src/dmlc-core/include/dmlc/common.h
src/dmlc-core/include/dmlc/serializer.h
src/dmlc-core/include/dmlc/omp.h
src/dmlc-core/include/dmlc/memory_io.h
src/dmlc-core/include/dmlc/registry.h
src/dmlc-core/include/dmlc/parameter.h
src/dmlc-core/include/dmlc/input_split_shuffle.h
src/dmlc-core/include/dmlc/memory.h
src/dmlc-core/include/dmlc/recordio.h
src/dmlc-core/include/dmlc/base.h
src/dmlc-core/include/dmlc/config.h
src/dmlc-core/include/dmlc/timer.h
src/dmlc-core/include/dmlc/threadediter.h
src/dmlc-core/include/dmlc/concurrency.h
src/dmlc-core/include/dmlc/type_traits.h
src/dmlc-core/include/dmlc/lua.h
src/dmlc-core/include/dmlc/thread_local.h
src/dmlc-core/include/dmlc/data.h
src/dmlc-core/include/dmlc/io.h
src/dmlc-core/include/dmlc/logging.h
src/amalgamation
src/amalgamation/xgboost-all0.cc
src/amalgamation/dmlc-minimum0.cc
src/xgboost_custom.cc
src/rabit
src/rabit/src
src/rabit/src/engine_mpi.cc
src/rabit/src/c_api.cc
src/rabit/src/allreduce_robust-inl.h
src/rabit/src/engine_mock.cc
src/rabit/src/allreduce_base.h
src/rabit/src/engine.cc
src/rabit/src/engine_base.cc
src/rabit/src/allreduce_mock.h
src/rabit/src/thread_local.h
src/rabit/src/engine_empty.cc
src/rabit/src/allreduce_base.cc
src/rabit/src/allreduce_robust.h
src/rabit/src/socket.h
src/rabit/src/allreduce_robust.cc
src/rabit/include
src/rabit/include/dmlc
src/rabit/include/dmlc/serializer.h
src/rabit/include/dmlc/base.h
src/rabit/include/dmlc/type_traits.h
src/rabit/include/dmlc/io.h
src/rabit/include/dmlc/logging.h
src/rabit/include/rabit
src/rabit/include/rabit/internal
src/rabit/include/rabit/internal/rabit-inl.h
src/rabit/include/rabit/internal/timer.h
src/rabit/include/rabit/internal/utils.h
src/rabit/include/rabit/internal/io.h
src/rabit/include/rabit/internal/engine.h
src/rabit/include/rabit/rabit.h
src/rabit/include/rabit/c_api.h
src/rabit/include/rabit/serializable.h
src/xgboost_R.h
src/xgboost_R.cc
src/xgboost_assert.c
src/Makevars.in
src/Makevars.win
src/include
src/include/xgboost
src/include/xgboost/learner.h
src/include/xgboost/base.h
src/include/xgboost/feature_map.h
src/include/xgboost/tree_updater.h
src/include/xgboost/objective.h
src/include/xgboost/c_api.h
src/include/xgboost/data.h
src/include/xgboost/metric.h
src/include/xgboost/tree_model.h
src/include/xgboost/logging.h
src/include/xgboost/gbm.h
NAMESPACE
demo
demo/generalized_linear_model.R demo/predict_leaf_indices.R demo/cross_validation.R demo/basic_walkthrough.R demo/custom_objective.R demo/early_stopping.R demo/poisson_regression.R
demo/00Index
demo/create_sparse_matrix.R demo/predict_first_ntree.R demo/tweedie_regression.R demo/caret_wrapper.R demo/boost_from_prediction.R
data
data/agaricus.test.rda
data/agaricus.train.rda
R
R/xgb.save.R R/utils.R R/xgboost.R R/xgb.Booster.R R/xgb.ggplot.R R/xgb.model.dt.tree.R R/xgb.plot.multi.trees.R R/xgb.DMatrix.R R/xgb.plot.deepness.R R/xgb.load.R R/xgb.importance.R R/xgb.plot.importance.R R/xgb.DMatrix.save.R R/xgb.plot.tree.R R/xgb.train.R R/xgb.dump.R R/callbacks.R R/xgb.save.raw.R R/xgb.cv.R R/xgb.create.features.R
vignettes
vignettes/xgboost.Rnw
vignettes/xgboostPresentation.Rmd
vignettes/discoverYourData.Rmd
vignettes/xgboost.bib
vignettes/vignette.css
MD5
build
build/vignette.rds
DESCRIPTION
configure
man
man/cb.early.stop.Rd man/dim.xgb.DMatrix.Rd man/getinfo.Rd man/cb.reset.parameters.Rd man/setinfo.Rd man/predict.xgb.Booster.Rd man/callbacks.Rd man/xgb.plot.deepness.Rd man/agaricus.test.Rd man/xgb.DMatrix.save.Rd man/xgboost-deprecated.Rd man/xgb.save.Rd man/cb.save.model.Rd man/print.xgb.DMatrix.Rd man/print.xgb.Booster.Rd man/print.xgb.cv.Rd man/xgb.plot.multi.trees.Rd man/cb.evaluation.log.Rd man/cb.print.evaluation.Rd man/xgb.plot.importance.Rd man/xgb.model.dt.tree.Rd man/xgb.create.features.Rd man/agaricus.train.Rd man/xgb.attr.Rd man/xgb.plot.tree.Rd man/xgb.load.Rd man/xgb.cv.Rd man/xgb.DMatrix.Rd man/cb.cv.predict.Rd man/dimnames.xgb.DMatrix.Rd man/xgb.save.raw.Rd man/xgb.importance.Rd man/xgb.train.Rd man/xgb.parameters.Rd man/slice.xgb.DMatrix.Rd man/xgb.dump.Rd
cleanup
LICENSE

Questions? Problems? Suggestions? or email at ian@mutexlabs.com.

Please suggest features or report bugs with the GitHub issue tracker.

All documentation is copyright its authors; we didn't write any of that.