Skip to content

Release
Compare
Choose a tag to compare
@Kieranties Kieranties released this 24 Nov 16:41
3.2.0
ef9afaf

Features

Support for CluedIn 3.2.0+

Changes:

See More
  • aa9c103 Fixes to outgoing references
  • 47b074c Further /Author fixes
  • 3a07cca Ensure all ModifiedBy, CreatedBy and OwnedBy edges with a /Person are outgoing edges
  • ee8d727 fix: ensure all assets are named correctly (#52)
  • dc47c2d fix: casing in classes
  • 27a11ab fix: file renaming
  • 400943d Merge
  • 8277506 Tweak packages.config
  • d6525eb fix: DI issue with ILogger on FileMetaDataClueProducer ctor
  • 9575176 Fixes #50
  • 53f1fd6 Feat: Enable netcore build
  • 45b7222 Removed reference to cluedIn.Core.Agent that was preventing running under ES 6 B/E server branch
  • 500cdea Updated to CluedIn Core 2.5.6
  • a6db0ba Merge pull request #45 from CluedIn-io/feature/Notes_in_the_crawler_is_wrong [ #44 ]
  • bf1c276 Cahnged to correct text
  • 9edd7a5 Notes in the crawler is 'wrong' #44
  • 9de5487 Fixes problem where data was not yielded back to processing pipeline correctly, resulting in timeout on large datasets #42 (#43)
  • e535286 Update implementation of IExtendedProviderMetadata (#41)
  • 80afb57 Changed all clue properties with dates to ISO 8601 (#38)
  • 937e0f6 Merge pull request #36 from CluedIn-io/bugfix/Log-Failure-Paths
  • acd1823 Log response content length rather than payload
  • ea75d55 Fix missing method runtime exceptions for logging
  • b90cce5 Add category web trait to tests requiring external internet access
  • fdd87d7 Add appropriate logging to failure paths
  • 556ac09 Update integration tests to reflect entity additions on test hubspot … (#22)
  • 9e64008 Merge pull request #35 from CluedIn-io/feature/Fix-JSON-returned-via-IExtendedProviderMetaData [ #34 ]
  • 52c4780 Fixes JSON returned via IExtendedProviderMetaData #34
  • d74a083 Merge pull request #33 from CluedIn-io/bugfix/set-correct-description-text
  • cf25aaa Set correct Description etc text returned via IExtendedProviderMetaData. [ #32 ]
  • f3eb5de Uses v2.4-alpha0079 Core packages (#31)
  • e82b5d1 Merge pull request #30 from CluedIn-io/vlad/fix-owner-response-route
  • 9c8d13f Removed extra slash from route
  • 5034501 Updates CrawlerIntegrationTesting to 1.1.3 to pull in v2.4 Core packages. All tests now pass (#29)
  • 8e5155b Embeds provider image as resource (#27)
  • dfc9642 Merge pull request #25 from CluedIn-io/fix/update-cluedin-references
  • 6d25b1e Change CrawlerIntegrationTesting package to v 1.1.2
  • 32ab466 Remove CluedIn.Server package reference
  • 56a367c Change CluedIn references to 2.4.0-alpha0073
  • 28d9871 Implements #23 (#24)
  • 089098f Update azure-pipelines.yml for Azure Pipelines
  • f5403aa Update azure-pipelines.yml for Azure Pipelines
  • 76fd879 Removes unwanted folders
  • b0a15ea Renamed test projects
  • 26334bb Renamed test folders
  • 830f01b Renamed HubSpot folders correctly
  • d1ae433 Renamed folders
  • 5334712 Merge pull request #21 from CluedIn-io/bugfix/handle-api-throttling
  • 0aa04af Merge branch 'develop' into bugfix/handle-api-throttling
  • 107a077 Merge pull request #16 from CluedIn-io/feature/documentation-release-pipeline
  • 3665fcb Merge pull request #17 from CluedIn-io/feature/adding-documentation
  • eac2b1a Updated CluedIn.Core packages
  • d64f9c0 Added entity mappings and config images
  • 890fe36 Adding images to readme
  • 9b6a04e Added exceptions folder
  • 8d526fd Added Daily usage limit check at start of crawl
  • 3fa9bd0 Started documentation
  • 9617a05 Fixed iterators to handle daily throttling and interval throttling
  • f2d0791 Updated azure-pipelines.yml to use doc publishing
  • 20a7e3e Added documentation placeholder
  • 7fa3851 Added documentation artifact releasing
  • 9127a0f Merge pull request #13 from CluedIn-io/bugfix/12-System-BadImageFormatException
  • 3d2fec5 Update CluedIn packages to 0938 alpha version
  • c06310d Fixes issue #12
  • e693ece Updated to CluedIn.Core 2.18.0-alpha0935 (#10)
  • a30e565 Commented int tests not available with expired Hubspot trial account used for dev
  • c3145d3 Fixed issue where crawling was not invoked due to mismatched component name
  • 1641ade Applied changes found in https://github.com/CluedIn-io/CluedIn/pull/758/files
  • 2434c0d Updated to latest CluedIn packages
  • 6ef293f Updated CluedIn* package references to latest
  • edb011c Corrected text in HubSpotConstants.cs
  • 98d4224 Merge pull request #8 from CluedIn-io/feature/Issue-7-Create-Nuspec
  • b5aeb4d Update azure-pipelines.yml
  • f63d58b Update azure-pipelines.yml
  • 9011e72 Update azure-pipelines.yml
  • e2797f0 Update azure-pipelines.yml
  • 32cae58 Update azure-pipelines.yml
  • 88f9ef6 Update azure-pipelines.yml
  • 5e3a82e $(buildConfiguration) consistency
  • 9f51621 comment out includeReferencedProjects
  • dda394c add feedsToUse config
  • d5d113c fix yaml
  • ebd896a WIP use nuget.exe pack
  • e3439ed Provide manual instructions on generating crawler and provider NuGet packages
  • f152f22 Merge pull request #4 from CluedIn-io/feature/cleanup-todo-list
  • d8e8e4c Remove unused field
  • 3664b39 Remove deprecated commented out code
  • 44fbfdb Prioritize NuGet package usage documentation
  • 4a7d8a4 Improve documentation on running unit and integration tests
  • 19f3d0d Fixed markdown formatting
  • 3f2bd57 Fixed typeos in readme
  • 58d2acb Updated readme with usage and debugging details
  • 5d8cae2 Commnent out int tests that arr no longer valdi as hubspot test account is expiring
  • 13cf2cd Merged develop into this branch
  • 512f937 Removed unnecessary TODO
  • 9dc01fc Removed irrelevant TODO's
  • 57e9443 Finished off any relevant TODO's in code
  • 49cd158 Remove some obsolete To Do's and fixed logging error in client
  • 4260e41 removed HubSpot... at start of config options
  • d216006 Removed trailing backslash from api base uri
  • e1d6cd5 Changed config settings to match convention Provider.NameSetting (ie Provider.HubSpoBaseUri)
  • 8dd7b85 Added verbose logging of calls to HubspotClient.GetAsync
  • c06f75b Improved error reporting
  • a317637 Added error logging to HubSpotProvider.GetAccountInformation()
  • 6128281 Fixed wrong ProviderId
  • 2beb8fb Removed reference to SystemVocabularies component in installer. Also, skipped some tests that cant currently run due to Hubspot privileges
  • af7702f Merge pull request #3 from CluedIn-io/feature/port-old-hubspot-code
  • f632315 Merge branch 'feature/port-old-hubspot-code' of https://github.com/CluedIn-io/CluedIn.Crawling.HubSpot into feature/port-old-hubspot-code
  • a34b569 Removed dependency on CluedIn.ContentExtraction
  • 9dbbc1c Remove requirement on having some package references
  • ee65b47 Merge branch 'feature/port-old-hubspot-code' of https://github.com/CluedIn-io/CluedIn.Crawling.HubSpot into feature/port-old-hubspot-code
  • 9fec9a6 Copied mesh tests. Left uncommented for now
  • c9e4ad3 Ported Mesh/Gdpr classes from main Repo. NOTE: NOT TESTED or tidied up to use HubSpot client
  • 59b5e66 Converted *.Test.Common.csproj to new format to allow dotnet build ot work and fix CI
  • 1ad287a Removed some compiler warnings to do with xUnit usage
  • 81df754 Force re-commit of Hubspot.Configuration
  • 41c3f7a Fixed build error
  • 73ba0c4 Merge branch 'feature/port-old-hubspot-code' of https://github.com/CluedIn-io/CluedIn.Crawling.HubSpot into feature/port-old-hubspot-code
  • a9d7bd2 Fixed tests
  • 5a27508 Added several more tests to HubspotProviderTests
  • 87fe27c [WIP] Filled-in missing functionality for HubSpotProvider, adding unit tests
  • 3000af0 Disabled clue dump to disk
  • af76cd9 Added dumping clues to disk to allow comparing with old crawler
  • 0f9a779 Started to complete some of the NotImplementedException's in HubSpotProvider
  • b67c886 Error handling implemented to allow crawling to continue on subsequent endpoints
  • 8167fe7 Moved ClueProducerTests to Crawling.HubSpot.Unit.Test and made it use BaseClueProducerTest
  • 5b67e0c Added sample Clue Producer test for Channel
  • 7e71673 Added unit tests for IHubSpotImageTester
  • a623791 Report test url to console
  • 98bea4e Fixed DataIngestion tests
  • 1bb68ba Added logging ot crawler
  • c1087e8 HubSpot login url now taken from app.config
  • 2a01187 Made LastCrawlTimeFinish overridable in config for testing purposes. Will default to what the Crawling sub-system provides otherwise
  • 4d58d8e Crawler config can be pulled from app.config now, and overriden using env vars
  • 51cce7b Restore real hubspot public uri for integration testing
  • 27918a8 Support async GetData public method
  • f12d8df Rename test projects
  • 74b7c4f Depend on interfaces rather than concrete types
  • 5ce9d9a crawl job data parameter required
  • eca3c33 HubSpot crawler unit tests refactored
  • a45ae43 Fix typo in namespace
  • fc481d5 Test stubs provisioned
  • 3d2eb6b Remove unused using statements
  • 43cf931 remove ignore for .cs files
  • 92fe95a Remove Namespace prefix from key classes
  • 7485592 Remove redundant this. prefixes
  • aabc29f [WIP] TODO markers for hard-coded Uri's
  • f399991 [WIP] add TODO marker to Metadata class
  • 96fb543 Provide table and portal ID test parameters
  • 5fc18af InRange assertions changed to NotEmpty
  • 247753b Add table rows system test
  • 85ef601 Integration tests point to wiremock docker instance
  • cec10fe Fix integration tests
  • 5445251 Replace InRange checks with NotEmpty and NotNull tests
  • f44e61c reduce size of tables HTTP response
  • 3ffeb48 dynamic contacts list response added
  • e475ffc Fix templates test
  • 3d21564 Reduced size of contacts properties response
  • 257f78f Remove root path redundant test
  • fc9c278 Add missing broadcast wire mocks
  • 5a1bb73 Add Site Maps mock
  • 6fc579a Add failing system tests for missing wire mocks
  • 20ba693 URL mappings mocks added
  • a2fab6c Email SMTP Tokens mock support added
  • ae1c952 [WIP] Skip keywords test, is this API retired?
  • 3f87a85 Blog posts and topics added plus calendar events
  • 1502e77 Rename unit test projects for CI to run
  • 8a6a538 Fixed happy path tests to use new return classes
  • 87ed1a6 Merge branch 'feature/port-old-hubspot-code' of https://github.com/CluedIn-io/CluedIn.Crawling.HubSpot into feature/port-old-hubspot-code
  • 3a2b54f Tested all endpoints possible. Table, SmtpTokens arent available with this truial version. Not sure how ot add Socal/Task Calender Events
  • 42f1116 Add missing acceptance tests
  • c388981 Add domains wire mock
  • 05099c3 Add social calendar events wire mock
  • 52ee0f9 Add workflows wire mock
  • 44cecd5 Add templates wire mock
  • f6587f8 Add blog wire mock
  • f3e516f tables mapping added
  • 0c808c5 Fix for HubSpotClient public API change
  • 67750f4 Merge branch 'feature/port-old-hubspot-code' of https://github.com/CluedIn-io/CluedIn.Crawling.HubSpot into feature/port-old-hubspot-code
  • eaa6193 [WIP] add HubSpotClient public method tests
  • 2bb26a8 Merge branch 'feature/port-old-hubspot-code' of https://github.com/CluedIn-io/CluedIn.Crawling.HubSpot into feature/port-old-hubspot-code
  • 9002117 Tested Company, Contact, Dynamic Contact, Files, SiteMaps, Templates, UrlMapping, Engagements against real world data
  • 921c7db Fix GetStaticContactListsAsync test
  • a4e8f88 All for empty property responses in integration tests
  • 062cabc Additional HubSpot API calls tested
  • 3544d01 Comment out acceptance tests
  • ca624b3 [WIP] Comment out integration tests
  • 5f04982 Revert "Example HubSpot API responses"
  • 1002232 Example HubSpot API responses
  • 2382521 Add braces for clarity
  • 96b8865 [WIP] Test fixes
  • d0da1d6 Add missing WireMock stubs
  • e6d9db8 [WIP] define HubSpot client integration tests
  • 249bcbe [WIP] add validation suppressions to clue producers
  • bd84797 Merge branch 'feature/port-old-hubspot-code' of https://github.com/CluedIn-io/CluedIn.Crawling.HubSpot into feature/port-old-hubspot-code
  • 6f67130 Split HubSpotCraler GetXXX functions out into testable classes
  • fe9a0e1 Fix for MSB1011
  • fbac8e3 Make verbose WireMock logging an opt-in feature
  • a04b79b Separate unit and integration test tasks
  • 29dcc07 Working with code and tests documentation added
  • caab4d9 Provide HTTP response error details in availability exception
  • 6547fde WireMock verbose request logging
  • dc152e3 HubSpot API BaseUri now injected via configuration
  • eb64850 Log GET request failures to Error stream
  • 808a148 Use WireMock stubs to test against
  • ff73844 WireMock urlPatterns applied
  • c64416f Output origin entity codes from crawler tests
  • dd2e9cc Fix typo in HubSpot casing
  • 27c45a8 Use UTC timestamp in ClueFactory
  • c575df7 Merge branch 'feature/port-old-hubspot-code' of https://github.com/CluedIn-io/CluedIn.Crawling.HubSpot into feature/port-old-hubspot-code
  • d58339f Remove TODO in test directory build properties
  • 965f273 Rename integration test project to following naming conventions
  • 7408e80 Update azure-pipelines.yml for Azure Pipelines
  • ef7ea1a Update azure-pipelines.yml for Azure Pipelines
  • 68dc8de Update azure-pipelines.yml for Azure Pipelines
  • d6667fc Remove unused using directives
  • 1dc4941 Solution Items grouped
  • 9a334a1 Merge branch 'feature/port-old-hubspot-code' of https://github.com/CluedIn-io/CluedIn.Crawling.HubSpot into feature/port-old-hubspot-code
  • 436a246 Refactor HubSpotTestFixture for debug support
  • 4ba8a05 Improved logging of web requests
  • c963073 Rename variable to crawlJobData
  • 81ede74 ditto
  • dc9c010 [WIP] MSBUILD : error : An error occurred: Invalid input for GitVersionTask.GenerateGitVersionInformation+Input.. [D:\source\CluedIn-io\CluedIn.Crawling.HubSpot\docker-compose.dcproj]
  • 22f085f WireMock HubSpot API defined
  • 05878df [WIP] WireMock HubSpot API
  • da36352 Merge branch 'feature/port-old-hubspot-code' of https://github.com/CluedIn-io/CluedIn.Crawling.HubSpot into feature/port-old-hubspot-code
  • 9748bbb Added expected entity type results to data ingestion test (for calls that can be called at present, due to permissions/scope errors)
  • c55d9cb Dockerfile added for wiremock
  • da53fd0 Merge branch 'feature/port-old-hubspot-code' of https://github.com/CluedIn-io/CluedIn.Crawling.HubSpot into feature/port-old-hubspot-code
  • 4e7dec9 Tested all endpoints, comment out those unable to call due to permisions, or deprecation
  • 811c32a Healthcheck added to WireMock docker service
  • a0a87e3 Wait for wiremock to be available before test run
  • ba2cdc9 Add HubSpot API to system tests
  • b628a1b Add docker-compose project to solution
  • 5f4eafc Provision WireMock support for HubSpot API:wq
  • d0ebceb Fixed some of the data ingestion class
  • 9012352 Finished Clue Producers
  • 4ce6352 Update GitVersionTask to 5.0.0-beta3-4
  • cb3d90c Added Contact, ContactList, Deal, DealPipeline clue producers
  • 089bd7a Added BlogPost, BoradcastMessage, CalendarEvent, Campaign, CampaignClue, Channel and Company clue processors

This list of changes was auto generated.

Assets 10
Loading