Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Nov 11, 2022

• Update README.md

  gramirez-prompsit

  authored
  61765e3

  Copy full SHA for 61765e3

• Update README.md

  gramirez-prompsit

  authored
  ee5856f

  Copy full SHA for ee5856f

• Update README.md

  gramirez-prompsit

  authored
  39ac556

  Copy full SHA for 39ac556

Commits on Nov 28, 2021

• Add fasttext model paths, switch CSD3 to icelake

  kpu

  committed
  f262d03

  Copy full SHA for f262d03

• Merge branch 'master' of git://github.com/paracrawl/cirrus-scripts

  kpu

  committed
  1442d48

  Copy full SHA for 1442d48

• Favor installing icu4c

  kpu

  committed
  e2f5347

  Copy full SHA for e2f5347

• Add status to list of options for setup.sh

  kpu

  committed
  515a61b

  Copy full SHA for 515a61b

• Fix boost download path

  kpu

  committed
  eaf3e2a

  Copy full SHA for eaf3e2a

• Point at https version of marian-dev

  kpu

  committed
  2f3390b

  Copy full SHA for 2f3390b

Commits on Sep 3, 2021

• Merge branch 'master' of github.com:paracrawl/cirrus-scripts

  jelmervdl

  committed
  cd65ae0

  Copy full SHA for cd65ae0

• Add local disk usage debugging

  jelmervdl

  committed
  6763930

  Copy full SHA for 6763930

• remove weird double cuda load

  jelmervdl

  committed
  dd3408a

  Copy full SHA for dd3408a

• Update warc2text and add pdf collection

  jelmervdl

  committed
  2f639e6

  Copy full SHA for 2f639e6

Commits on Aug 14, 2021

• Also schedule alignment for files that do not exist (yet\!)

  jelmervdl

  committed
  cdd7366

  Copy full SHA for cdd7366

Commits on Aug 10, 2021

• Update README

  jelmervdl

  committed
  a591c0f

  Copy full SHA for a591c0f

• Update pdfwarc2warc

  jelmervdl

  committed
  2ecde26

  Copy full SHA for 2ecde26

Commits on Aug 9, 2021

• Fix issue with retry

  jelmervdl

  committed
  7290a06

  Copy full SHA for 7290a06

• Enable 04.translate.sh again in pipeline.

  Show description for 5618cd4
  jelmervdl

  committed
  5618cd4

  Copy full SHA for 5618cd4

• Update pdfwarc2warc to incude new fixes wrt @tab@ and Content-Type headers

  jelmervdl

  committed
  ec49edc

  Copy full SHA for ec49edc

• Fix -r in pdf2warc.sh

  jelmervdl

  committed
  8e674aa

  Copy full SHA for 8e674aa

• Give parsr its own temp dir that we explicitly delete. The job temp dir is kept between jobs on the same node (the same SLURM job) and it was overflowing the local disk.

  jelmervdl

  committed
  a4db55d

  Copy full SHA for a4db55d

Commits on Aug 4, 2021

• Make fake-sbatch.sh compatible with '%' op in --array

  jelmervdl

  committed
  2d1bc5e

  Copy full SHA for 2d1bc5e

• Add experimental pdf2warc step

  jelmervdl

  committed
  665081d

  Copy full SHA for 665081d

Commits on Jul 15, 2021

• Deal with the 'no really means nb' debacle

  jelmervdl

  committed
  1447753

  Copy full SHA for 1447753

Commits on Jul 13, 2021

• Add script to find cleaning output files

  jelmervdl

  committed
  519ab94

  Copy full SHA for 519ab94

• Get bicleaner-hardrules with fastspell to build (does not include getting model data in place)

  jelmervdl

  committed
  6c83a6c

  Copy full SHA for 6c83a6c

Commits on Jul 9, 2021

• Add hunspell on gitignore

  jelmervdl

  committed
  4c2cbf5

  Copy full SHA for 4c2cbf5

• Make pipeline.sh always execute local files

  jelmervdl

  committed
  08abe85

  Copy full SHA for 08abe85

• Add work-around for bicleaner-ai not being happy about empty sentences

  jelmervdl

  committed
  162aa3b

  Copy full SHA for 162aa3b

• Add hunspell

  jelmervdl

  committed
  a3c7ab9

  Copy full SHA for a3c7ab9

Commits on Jul 5, 2021

• We know all translations are done

  jelmervdl

  committed
  9097d93

  Copy full SHA for 9097d93

• Add extra checks to steps to fail earlier and more predictable

  jelmervdl

  committed
  28a7265

  Copy full SHA for 28a7265

• Re-schedule files for processing if the source files were updated

  jelmervdl

  committed
  d830bfb

  Copy full SHA for d830bfb

• Make score-wrap.py fail if the read thread fails

  jelmervdl

  committed
  9bea066

  Copy full SHA for 9bea066

Commits on Jun 24, 2021

• Update functions.sh with documentation and option to add custom options

  jelmervdl

  committed
  1e3d86e

  Copy full SHA for 1e3d86e

Pagination

Previous

Next