Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/range setup fixes #18

Merged

Conversation

ashrodan
Copy link
Contributor

A range of local tweaks to make it work for someone getting started.

  • Also added a setup task to setup someone's env.
  • Fixed the start and end date to read from utcnow instead of now as gmt+10 was returning errors.
  • Pegged duckdb 0.8.1 as 0.9.0 is not supported by Evidence Bi.

p.s. love the stack.

Maybe we could put dbt into its own folder?

@netlify
Copy link

netlify bot commented Sep 28, 2023

‼️ Deploy request for polite-douhua-c3edc5 rejected.

Name Link
🔨 Latest commit db57981

Copy link
Owner

@gwenwindflower gwenwindflower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TYSM! This is all great thinking and super appreciated.

Taskfile.yml Outdated
Comment on lines 5 to 6
- python -m venv .venv # Create a virtual environment
- source .venv/bin/activate # Activate the virtual environment
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so, i initially tried this, and unfortunately because Task runs things in subshells, the activation of the venv is borderline impossible (would require massive backflips not worth the price of admission) so i think the venv stuff should maybe come out. but otherwise, fantastic call 🙌🏻

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

alternatively, if you disagree, we could leave this all in but people would just need to activate the venv again manually after this step. not sure if that's simpler or more confusing, open to thoughts/ideas.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ahh yep removed thanks

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe a setuptools or poetry package manager might be worthwhile?

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i've noticed poetry adding some extra abstraction and thus confusion to people learning the python flow (from time teaching and consulting), so in the interest of prioritizing understanding over convenience i don't want to go that route BUT -- i'm wondering if maybe rather than a setup step in Task, there's a setup.sh script that does everything for the initial setup automatically just to accelerate people and they can come back to various things more modularly. not as nice as having it at all aligned in Task but perhaps the best compromise available. 🤔

Taskfile.yml Outdated Show resolved Hide resolved
Taskfile.yml Outdated
- source .venv/bin/activate # Activate the virtual environment
- python -m pip install -r requirements.txt
- dbt deps
- npm --prefix ./reports install
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, we should add pre-commit install to the setup (i need to add information on this to the docs i'm realizing), i realized the requirements.txt changes here didn't get alpha-sorted which means pre-commit didn't run, and that would make sense because i don't call it out in the README or setup tasks!

@gwenwindflower gwenwindflower merged commit 8a1b2fd into gwenwindflower:main Sep 28, 2023
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants