Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat/youtube #2166

Open
wants to merge 190 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
190 commits
Select commit Hold shift + click to select a range
6a15902
Add youtube integration
Fahme Aug 22, 2023
bd60983
Remove useless comments
Fahme Aug 22, 2023
659689b
fix typo
Fahme Aug 22, 2023
f16e4d7
Fix more typos
Fahme Aug 22, 2023
4bc32b3
Add more guards and fix issues
Fahme Sep 2, 2023
bdcdb59
merge
Fahme Sep 6, 2023
982a78c
add a maximum number of pages to fetch
Fahme Sep 11, 2023
a951cc9
fix formating issues
Fahme Sep 11, 2023
94d6135
Merge branch 'main' into YT/integration
bnchi Sep 27, 2023
ab87e2b
Merge branch 'main' into YT/integration
bnchi Dec 5, 2023
c894429
init temporal search attribute (#1943)
Dec 11, 2023
8e4120e
Support incident status in public status endpoint (#1945)
joanagmaia Dec 11, 2023
61d8302
Cube MVs tenant indexes (#1946)
sausage-todd Dec 11, 2023
54aff56
Prevent overwrite of dynamic attributes on member merge (#1937)
skwowet Dec 11, 2023
b43a1f6
Bugfix/manual org changes overridden by enrichment c 2903 (#1944)
Dec 12, 2023
61c0a6f
Essential free plan cancelation banner (#1950)
gaspergrom Dec 12, 2023
ddb1143
Enhancement/queue prioritization c 2633 (#1900)
Dec 12, 2023
ef8d10c
quick fix
Dec 12, 2023
9bef427
fix deploy action
Dec 12, 2023
6c232bc
lfx and staging deploys fixed
Dec 12, 2023
7fc3d06
Improvement/test member enrichment with logs (#1953)
Dec 12, 2023
5103703
fix query error when checking for delayed results (#1956)
Dec 13, 2023
b002104
bugfix
Dec 13, 2023
2173c50
receive and delete from a specific queue
Dec 13, 2023
2059853
removed info log on every message
Dec 13, 2023
ee1fb0c
use true for default value for onboarding when runId is null for inte…
Dec 13, 2023
53642dc
Missing awaits on merging roles (#1958)
epipav Dec 13, 2023
2e67f83
Add checks for paid Discord integrations (#1961)
garrrikkotua Dec 13, 2023
78e6ea1
Better organization existence checks and organizations without activi…
epipav Dec 13, 2023
01d7d62
Update script path for trigger-all-webhooks (#1965)
garrrikkotua Dec 13, 2023
3e54b47
bugfix
Dec 14, 2023
5087654
Fix member add handler in discord-ws (#1967)
garrrikkotua Dec 14, 2023
005a79e
fixed ci deploy (#1968)
Dec 14, 2023
32847a9
Fix member copy and banner validation (#1966)
joanagmaia Dec 15, 2023
c66ceeb
Fix identity display name in merge dialog (#1969)
joanagmaia Dec 15, 2023
0b4fa7d
Fix pre-selected remote filters (#1972)
joanagmaia Dec 15, 2023
8577e4d
Fix contacts query search in organization profile (#1975)
joanagmaia Dec 18, 2023
f0407c3
Increase Cube timeouts for emails
loicsaintroch Dec 18, 2023
900d69a
Increase Cube timeouts for emails
loicsaintroch Dec 18, 2023
e113d7e
Serve organization profiles from OpenSearch (#1952)
skwowet Dec 18, 2023
0d9dc01
Serve contact profiles from OpenSearch (#1954)
skwowet Dec 18, 2023
3f77440
Fix git/github commits activities (#1981)
garrrikkotua Dec 20, 2023
0c5e23d
Member merge async (#1979)
sausage-todd Dec 20, 2023
fc0795f
Update email domains blacklist (#1974)
skwowet Dec 20, 2023
5a99916
Parse attributes that are strings and add missing fields in member pr…
skwowet Dec 20, 2023
db3827f
Fix organization OpenSearch translator (#1987)
skwowet Dec 21, 2023
c5795f5
Enrichment sneak peak (#1941)
gaspergrom Dec 21, 2023
55c819c
Add async feedback to organizations merge (#1970)
joanagmaia Dec 21, 2023
4f3cd0a
Fix display of attributes in contacts (#1989)
joanagmaia Dec 21, 2023
b2e323d
Remove .git from GitHub and Git channels (#1990)
garrrikkotua Dec 22, 2023
66bf4e8
Fix null attribute (#1993)
joanagmaia Dec 22, 2023
d879efd
Fix reach display (#1992)
joanagmaia Dec 22, 2023
a969333
Init new members enrichment worker (#1942)
loicsaintroch Dec 22, 2023
94a6ed4
Index member `reach` as object in OpenSearch (#1995)
skwowet Dec 22, 2023
f14e36d
add script to remove organization from OpenSearch (#1999)
skwowet Dec 22, 2023
cb3be7f
Pricing changes (#1973)
gaspergrom Dec 28, 2023
f4131b5
Handle plan manual cancelation
gaspergrom Dec 28, 2023
26afa9b
fix organization manual `website` update and handle error (#1997)
skwowet Jan 2, 2024
637c77c
Org merge temporal (#2005)
sausage-todd Jan 2, 2024
246bfe5
Fix 404 error in profile for organizations from member enrichment (#2…
skwowet Jan 3, 2024
993989e
Fix generic boolean filter (#2009)
joanagmaia Jan 3, 2024
57d3360
Ignore wrong email addresses from enrichment (#2001)
loicsaintroch Jan 3, 2024
70d41ee
Improvement/merge suggestions worker (#1971)
epipav Jan 3, 2024
2cdba7f
typo fixed in workflow names
epipav Jan 3, 2024
66b97c2
filtering out null email values when getting merge suggestions
epipav Jan 3, 2024
62bbd4b
deduplication using window function instead for stable results in mer…
epipav Jan 3, 2024
fcbb7d0
Fix tenant identity (#2012)
gaspergrom Jan 4, 2024
d392c1b
Improvement/prevent creation of duplicate member suggestions (#2022)
epipav Jan 5, 2024
25e532b
More optimization on member merge suggestions getter (#2024)
epipav Jan 5, 2024
a243e29
Add optional similarity filter in member merge suggestions for segmen…
epipav Jan 5, 2024
1f4545e
Common actions and merge suggestions on member pages (#2018)
gaspergrom Jan 5, 2024
f1fe904
Change layout for merge suggestions (#2011)
gaspergrom Jan 5, 2024
5440bb2
Do not override organization name on enrichment (#2027)
loicsaintroch Jan 5, 2024
6905f5c
Refactor identities display (#2023)
joanagmaia Jan 5, 2024
d28b124
Fix empty emails and phone numbers (#2028)
joanagmaia Jan 5, 2024
bda1bff
Fix identities overflow (#2032)
joanagmaia Jan 5, 2024
f909317
Fix email verify flow (#2034)
gaspergrom Jan 7, 2024
08f5004
Select only tenants with active paid plan (#2037)
loicsaintroch Jan 8, 2024
0d9a708
Fix missing members joined at data (#2019)
sausage-todd Jan 8, 2024
c67928e
Replace parent segment with leaf segments for member `lastActivity` (…
skwowet Jan 8, 2024
31f906e
Merge suggestion preview (#2040)
gaspergrom Jan 8, 2024
fc79c4b
Init profiles worker with member affiliations update (#1962)
loicsaintroch Jan 8, 2024
e183425
Improve affiliations success message (#2021)
joanagmaia Jan 8, 2024
819884f
Improve merge feedback message (#2030)
joanagmaia Jan 8, 2024
46009da
Cubejs library split app and cli (#2038)
epipav Jan 8, 2024
9e8af11
Enhancement/org enrichment with temporal c 2905 (#2035)
Jan 9, 2024
0ad4962
Fetch member's segments after by-id query to opensearch (#2042)
sausage-todd Jan 9, 2024
f2a3eca
Fix modal on github onboarding (#2045)
joanagmaia Jan 9, 2024
e61003c
Better deployment (#2047)
Jan 9, 2024
29d7e36
Fix merge suggestions loading (#2048)
gaspergrom Jan 9, 2024
6ffb59c
testing custom action
Jan 9, 2024
ca768fb
testing custom action
Jan 9, 2024
540e984
testing custom action
Jan 9, 2024
203ae99
testing custom action
Jan 9, 2024
150bb68
testing custom action
Jan 9, 2024
a383354
testing custom action
Jan 9, 2024
43de855
testing docker action
Jan 9, 2024
4c6545a
testing custom action
Jan 9, 2024
0001d28
fix
Jan 9, 2024
bfd44ae
testing docker action
Jan 9, 2024
f18fa49
testing docker action
Jan 9, 2024
d087281
testing custom action
Jan 9, 2024
1e0a106
testing custom action
Jan 9, 2024
17a0313
testing docker action
Jan 9, 2024
5a4aedf
testing docker action
Jan 9, 2024
9c7e745
testing docker action
Jan 9, 2024
09bffe0
fix: manual activity addition for custom platform types (#2049)
skwowet Jan 9, 2024
dd518c2
Remove all enrich manual actions (#1911)
gaspergrom Jan 9, 2024
761c142
Start enriching tenants with Growth plan (#2052)
loicsaintroch Jan 9, 2024
46abde5
testing custom action
Jan 10, 2024
76c5832
Improve find-existing-acitivty query in data-sink-worker (#2056)
sausage-todd Jan 10, 2024
b965648
Make search sync asynchronous when merging orgs (#2053)
sausage-todd Jan 10, 2024
1a06e86
new deployment
Jan 10, 2024
c441a6e
Merge branch 'main' of github.com:CrowdDotDev/crowd.dev
Jan 10, 2024
dbee533
Simplify onboarding flow in integrations (#2054)
joanagmaia Jan 10, 2024
7fb47f0
Improve member-last-activities query in `findAndCountAllOpensearch` (…
sausage-todd Jan 11, 2024
fd7d574
Fix short title/description in emails (#2064)
loicsaintroch Jan 11, 2024
fe0ca5d
linting fix
Jan 11, 2024
20c2a6d
Entity merging fixes (#2070)
sausage-todd Jan 12, 2024
7b8e4ec
Improved org enrichment (#2071)
Jan 12, 2024
23beca5
Make sure name-website combination is unique in organizationCacheIden…
Jan 12, 2024
3810e39
Fixed org cache identity insert query typo (#2078)
Jan 15, 2024
25b64f0
Disable tenant creation for invited users (#2080)
gaspergrom Jan 15, 2024
7071c8a
bugfix
Jan 15, 2024
2058035
bugfix
Jan 15, 2024
f98e61a
only get orgs to enrich that have proper identities
Jan 15, 2024
77c7f1c
Entity merging fixes (#2081)
sausage-todd Jan 15, 2024
ff0620a
improvements and fixes
Jan 16, 2024
16a8a0a
Dashboard caching (#2086)
epipav Jan 16, 2024
f7db602
update start to close timeout for refresh cache activities
epipav Jan 16, 2024
050ca38
bugfix
Jan 16, 2024
1a129df
Added source (#2088)
Jan 16, 2024
139fd2a
Cubejs improvements for dashboard caching (#2090)
epipav Jan 16, 2024
d9450ed
fix job-generator import issue
epipav Jan 16, 2024
c97157c
API performance (#2089)
sausage-todd Jan 16, 2024
a83ca5b
keep same id for different cache refresh runs
epipav Jan 16, 2024
1a2a597
Dashboard optimize (#2075)
gaspergrom Jan 17, 2024
492c774
Edit member ctas (#2077)
gaspergrom Jan 17, 2024
73f969b
Enhancement/activities endpoints improvement lfx 569 (#2095)
Jan 17, 2024
46cbae4
Dashboard caching retries fixes (#2098)
epipav Jan 17, 2024
df49ed9
Fix `Cannot read properties of null (reading 'id')` (#2100)
sausage-todd Jan 17, 2024
5123b60
Fix dashboard errors (#2102)
gaspergrom Jan 17, 2024
451125c
Fix sentiment dashboard (#2106)
gaspergrom Jan 17, 2024
677462d
Add support for commits from orgs and indirect forks in GitHub integr…
garrrikkotua Jan 17, 2024
69240b2
Activity query multiple orderbys (#2103)
joanagmaia Jan 17, 2024
ab5c25a
Quick win for conversations endpoint (#2099)
loicsaintroch Jan 17, 2024
83ee81a
Improve `/membersToMerge` endpoint (#2109)
sausage-todd Jan 17, 2024
c82d5a3
index using async req to search-sync-worker (#2096)
Jan 18, 2024
3db02cc
Update README.md
jonathimer Jan 18, 2024
5dec9d2
fake user
garrrikkotua Jan 18, 2024
d34a50c
member_segments_mv, refreshing of the materialized view and usage in …
Jan 19, 2024
c8aba00
bugfix
Jan 19, 2024
c442f54
Scaling fixes for dashboard caching (#2122)
epipav Jan 19, 2024
e5f55f7
Support multiple repos in manual runs for GitHub integration (#2123)
garrrikkotua Jan 19, 2024
001bcf0
Fix activity graph
gaspergrom Jan 19, 2024
28f9674
uuid <-> string translation issue in affiliations (#2125)
epipav Jan 19, 2024
2bdfe31
Active organizations endpoint using activity index, cubejs new member…
epipav Jan 23, 2024
34ca09b
Add script to delete tenants and data (#2138)
skwowet Jan 23, 2024
241e78f
Update endpoint to get active organizations (#2132)
joanagmaia Jan 23, 2024
11ebc3d
Increase query timeout for purging tenants script (#2140)
skwowet Jan 23, 2024
9d67541
Have trnx for each tenant while purging with script (#2141)
skwowet Jan 23, 2024
904e2ee
Cleanup hostname from bunyan fields in prod logs (#2143)
sausage-todd Jan 23, 2024
ec3a655
Merge suggestions ux improvements (#2134)
gaspergrom Jan 24, 2024
3ac2004
Remove duplicate reset on organization edit
gaspergrom Jan 24, 2024
03cafb0
Improve merge success message (#2146)
joanagmaia Jan 24, 2024
3d679e6
Custom reports quick wins (#2142)
joanagmaia Jan 24, 2024
e1f5e7d
Engagement level labels added to members cube as a separate dimension…
epipav Jan 24, 2024
ffd18ab
Bugfix/new orgs identity platform filter fix (#2148)
epipav Jan 25, 2024
6fcd743
Use OpenSearch for CSV exports (#2149)
loicsaintroch Jan 25, 2024
b93dc65
Fix organization name and add additional attributes in CSV export (#2…
skwowet Jan 25, 2024
32a17df
Fix url unique (#2153)
gaspergrom Jan 26, 2024
9751079
Remove contacts enrichment tracking (#2151)
joanagmaia Jan 26, 2024
2ce6849
Reddit no deleted users (#2145)
garrrikkotua Jan 29, 2024
bb45f49
Hubspot sync errors (#2154)
epipav Jan 29, 2024
fa40b55
Button ui kit & colors variables (#2152)
gaspergrom Jan 29, 2024
3690bb0
Add profile link to merge suggestions (#2156)
joanagmaia Jan 30, 2024
558ac04
Fix dockerfiles
gaspergrom Jan 30, 2024
3ba566e
Add config to dockerfile
gaspergrom Jan 30, 2024
572868a
Ui kit card (#2158)
gaspergrom Jan 30, 2024
ea86bda
catch and log error when starting a temporal workflow
Jan 31, 2024
7223aa1
Added a unique index to organizationCacheIdentities.name column (#2160)
Jan 31, 2024
eb52c08
Improve throttler for Hubspot requests (#2161)
epipav Jan 31, 2024
a3ea8c4
Add historical limits to Twitter (#2162)
garrrikkotua Jan 31, 2024
dd8e30c
Ui kit checkbox (#2159)
gaspergrom Feb 1, 2024
de9f04c
Improve profile drawers (#2120)
gaspergrom Feb 1, 2024
189dc0c
Bug fixing profile drawers (#2163)
gaspergrom Feb 1, 2024
5091827
Fix subreddit existence check endpoint (#2059)
garrrikkotua Feb 1, 2024
1080048
Fix identity managing
gaspergrom Feb 1, 2024
12c4d82
Fix view more dashboard links (#2165)
joanagmaia Feb 1, 2024
168b8bc
Merge branch 'main' into feat/youtube
garrrikkotua Feb 1, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
40 changes: 39 additions & 1 deletion .github/actions/deploy-service/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,16 @@ inputs:
description: To which cloud cluster to deploy
required: true

prioritized:
description: Is the service listening on prioritized queues?
required: false
default: 'false'

cloud_env:
description: Which cloud environment are we deploying to?
required: false
default: 'default'

runs:
using: composite
steps:
Expand All @@ -25,10 +35,38 @@ runs:
AWS_SECRET_ACCESS_KEY: ${{ env.AWS_SECRET_ACCESS_KEY }}
AWS_REGION: ${{ env.AWS_REGION }}

- name: Deploy image
- name: Deploy image (non prioritized)
if: inputs.prioritized == 'false'
shell: bash
run: kubectl set image deployments/${{ inputs.service }}-dpl ${{ inputs.service }}=${{ inputs.image }}

- name: Deploy image (prioritized - production)
if: inputs.prioritized == 'true' && inputs.cloud_env == 'prod'
shell: bash
run: |
kubectl set image deployments/${{ inputs.service }}-system-dpl ${{ inputs.service }}-system=${{ inputs.image }}
kubectl set image deployments/${{ inputs.service }}-normal-dpl ${{ inputs.service }}-normal=${{ inputs.image }}
kubectl set image deployments/${{ inputs.service }}-high-dpl ${{ inputs.service }}-high=${{ inputs.image }}
kubectl set image deployments/${{ inputs.service }}-urgent-dpl ${{ inputs.service }}-urgent=${{ inputs.image }}

- name: Deploy image (prioritized - lfx production)
if: inputs.prioritized == 'true' && inputs.cloud_env == 'lfx_prod'
shell: bash
run: |
kubectl set image deployments/${{ inputs.service }}-system-dpl ${{ inputs.service }}-system=${{ inputs.image }}
kubectl set image deployments/${{ inputs.service }}-normal-dpl ${{ inputs.service }}-normal=${{ inputs.image }}
kubectl set image deployments/${{ inputs.service }}-high-dpl ${{ inputs.service }}-high=${{ inputs.image }}

- name: Deploy image (prioritized - staging)
if: inputs.prioritized == 'true' && inputs.cloud_env == 'staging'
shell: bash
run: kubectl set image deployments/${{ inputs.service }}-normal-dpl ${{ inputs.service }}-normal=${{ inputs.image }}

- name: Deploy image (prioritized - lfx staging)
if: inputs.prioritized == 'true' && inputs.cloud_env == 'lfx_staging'
shell: bash
run: kubectl set image deployments/${{ inputs.service }}-normal-dpl ${{ inputs.service }}-normal=${{ inputs.image }}

- uses: ./.github/actions/slack-notify
with:
message: 'Service *${{ inputs.service }}* was just deployed using docker image `${{ inputs.image }}`'
21 changes: 21 additions & 0 deletions .github/actions/node/.eslintrc.cjs
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
module.exports = {
parser: '@typescript-eslint/parser',
extends: [
'eslint:recommended',
'plugin:@typescript-eslint/recommended',
'plugin:prettier/recommended',
],
plugins: ['@typescript-eslint', 'prettier'],
parserOptions: {
ecmaVersion: 2022,
sourceType: 'module',
},
env: {
es6: true,
node: true,
},
rules: {
'prettier/prettier': 'error',
'@typescript-eslint/explicit-module-boundary-types': 'off',
},
}
3 changes: 3 additions & 0 deletions .github/actions/node/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
node_modules/
dist/
out/
3 changes: 3 additions & 0 deletions .github/actions/node/.prettierignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
dist/
.eslintrc.cjs
.prettierrc.cjs
7 changes: 7 additions & 0 deletions .github/actions/node/.prettierrc.cjs
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
module.exports = {
singleQuote: true,
arrowParens: 'always',
printWidth: 100,
trailingComma: 'all',
semi: false,
}
20 changes: 20 additions & 0 deletions .github/actions/node/builder/action.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
name: Deployer
description: Custom Deployer Action

inputs:
services:
description: Services to deploy
required: true
tag:
description: Tag for images
required: false
default: ${{ github.sha }}
steps:
description: Steps to run
required: false
default: build push deploy

runs:
using: node16
main: index.js
post: index.js
Loading
Loading