# Changelog

## [v0.1.0-alpha](https://github.com/AdRoll/baker/tree/v0.1.0-alpha) - 2021-03-19

### Added

- upload: add S3 uploader component [#15](#15)
- filter: add ClearFields filter [#19](#19)
- output: add Stats output [#23](#23)
- filter: add SetStringFromURL filter [#28](#28)
- output: add FileWriter output in replacement of Files output  [#31](#31)
- upload: s3: add `ExitOnError` configuration [#27](#27)
- uploads now return an error instead of panicking and baker deals with it [#27](#27)
- general: replace `${KEY}` in the TOML conf with the `$KEY` env var [#24](#24)
- input: add KCL input. [#36](#36)
- filter: add RegexMatch filter. [#37](#37)
- filter: add NotNull filter [#43](#43)
- filter: add Concatenate filter [#28](#33)
- Required configuration fields are now handled by Baker rather than by each component. [#41](#41)
- filter: add TimestampRange filter [#46](#46)
- filter: add ReplaceFields filter [#49](#49)
- filter: add Timestamp filter [#54](#54)
- Add Record.Copy method [#53](#53)
- Add pkg/splitwriter and pkg/buffercache reusable components [#55](#55)
- output: add SQLite output [#56](#56)
- README: document KCL input [#59](#59)
- Document how to specialize baker.LogLine [#63](#63)
- Add `baker.MainCLI` [#73](#73)
- Implement markdown rendering of component help/configuration [#80](#80)
- Add `[fields]` section in TOML in which use can define field indexes <-> names mapping [#84](#84)
- Add StringMatch filter which discards/keeps records based on the result of string comparisons  [#102](#102)
- Add PartialClone filter [#107](#107)
- Add `[validation]` section in TOML in which users can define record validation through regex [#122](#122)
- Add ExpandJSON filter [#128](#128)
- Add Hash filter with the support of md5 and sha256 algorithms [#130](#130)
- Add MetadataLastModified filter [#133](#133)
- Add Dedup filter [#143](#143)
- Add MetadataUrl filter [#147](#147)
- Add FormatTime filter [#151](#151)
- Add ExpandList filter [#155](#155)

### Changed

- Do not force GOGC=800, let inputs decide and user have final word [#13](#13)
- Move aws-specific utilities into a new `awsutils` package [#14](#14)
- Outputs' `Run()` returns an error [#21](#21)
- Fix 2 panics: ValidateRecord and errUnsuportedURLScheme [#29](#29)
- Remove datadog-specific code from [general] section. Instead add [metrics] which can be extended with baker.MetricsClient interfaces. [#34](#34)
- Remove duration parameter from baker.Main [#62](#62)
- TimestampRange filter accepts 'now' as range [#106](#106)
- Standardize the components' structs names [#105](#105)
- **Breaking** Change func FieldName to FieldNames (slice) as it allows to know the number of defined fields [#110](#110)
- ExpandList filter just forwards if the source field is empty [#171](#171)

### Removed

- output: remove the Files output in favor of the more generic FileWriter [#31](#31)

### Fixed

- Fix a bug in `logline.Copy` [#64](#64)
- Fix building on windows [#115](#115)
- Fix `list_test` with file URI to be compatible with windows paths [#117](#117)
- Fix `List` input, some `io.Reader`'s were left opened [#118](#118)
- Fix some bugs in `s3.s3UploadFile` [#120](#120)
- `SplitWriter` leaves some file descriptors open [#119](#119) and [#121](#121)
- `PrintHelper()` now supports map type as configuration parameter of a Baker component [#138](#138)
- `List` input did not consider drive letter on Windows paths [#139](#139)
- Do not insert newline after dots in generated help markdown [#140](#140)
- Fix data race in statsDumper [#154](#154)
- SetStringFromURL filter panics if MetadataURL was not set. [#156](#156)
- MetadataLastModified filter wrongly counts the number of processed records [#157](#157)
- `List` input did not correctly manage HTTP status codes [#163](#163)

### Maintenance

- input: Fixes `List` input not managing S3 "folders" [#35](#35)
- input: with [#35](#35) we introduced a regression that has been fixed with [#39](#39)
- upload: fixes a severe concurrency issue in the uploader [#38](#38)
 remove `output.RawChanSize`