Skip to content

An ability to add goodtables checks to the validate processor #142

@roll

Description

@roll

Overview

From goodtabes@3 (now early alpha) it will have a function like system.create_check('baseline/integrity/etc') returning a check object with check.validate_headers/row/table available. The amount of checks have been drastically reduces (only 2 core checks and 6 advanced).

So we will be able to integrate it into the validate processor like (maybe adding core checks baseline/integrity by default):

Flow(
    validate(extra_checks=['baseline', 'integrity', ('blacklisted-value', {'fieldName': 'name'}), ...]
)

As an output, I think we just can add the errors list to a resource descriptor with a list of found errors.

Initially dataflows-goodtables integration is a @cschloer's idea but, for now, I don't see how we can friend them due to their streaming-nature without going to lower-level (the level of the individual check).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions