Skip to content

Latest commit

 

History

History
361 lines (294 loc) · 23.5 KB

CHANGELOG.md

File metadata and controls

361 lines (294 loc) · 23.5 KB
Raw

Pulsar-client-go Changelog

All notable changes to this project will be documented in this file.

[0.7.0] 2021-10-31

Feature

  • Encryption support for producer, see PR-560
  • Decrytion support for consumer, see PR-612
  • User-defined metric cardinality, see PR-604
  • Better support for Azure AD OAuth 2.0, see PR-630, PR-633, PR-634
  • Removed testing for go versions 1.11 and 1.12, see PR-632
  • Add epoch to create producer to prevent a duplicate producer when broker is not available., see [PR-582] (apache#582)

Improve

  • Fix batch size limit validation, see PR-528
  • Fix logic of command for sendError, see PR-622
  • Drain connection requests channel without closing, see PR-645
  • Fix ConsumersOpened counter not incremented when use multitopic or regexp consumer, see PR-619
  • Fix reconnection logic when topic is deleted, see PR-627
  • Fix panic when scale down partitions, see PR-601
  • Fix missing metrics for topics by registration of existing collector, see PR-600
  • Fix producer panic by oldProducers, see PR-598
  • Fail pending messages when topic is terminated, see PR-588
  • Fix handle send error panic, see PR-576

[0.6.0] 2021-07-21

Feature

  • Make PartitionsAutoDiscoveryInterval configurable, see PR-514.
  • Always check connection close channell, before attempting to put requests, see PR-521.
  • Add LedgerId,EntryId,BatchIdx,PartitionIdx func for MessageId interface, see PR-529.
  • Add DisableReplication to Producer Message, see PR-543.
  • Updating comments to conform to golang comment specification, see PR-532.
  • Producer respects Context passed to Send() and SendAsync() when applying backpressure, see PR-534.
  • Simplify connection close logic, see PR-559.
  • Add open tracing to pulsar go client, see PR-518.
  • Update proto file, see PR-562.
  • Add send error logic for connection, see PR-566.
  • Add license file for depend on libs, see PR-567.

Improve

  • Update jwt-go dependency to resolve vulnerabilities, see PR-524.
  • Fixed Athenz repository name, see PR-522.
  • Fix reader latest position, see PR-525.
  • Fix timeout guarantee for RequestOnCnx, see PR-492.
  • Fix nil pointer error with GetPartitionedTopicMetadata, see PR-536.
  • Release locks before calling producer consumer response callbacks, see PR-542.
  • Fix lookup service not implemented GetTopicsOfNamespace, see PR-541.
  • Regenerate the certs to work with Pulsar 2.8.0 and Java 11, see PR-548.
  • Fix race condition when resend pendingItems, see PR-551.
  • Fix data race while accessing connection in partitionConsumer, see PR-535.
  • Fix channel data race, see PR-558.
  • Fix write to closed channel panic() in internal/connection during connection close, see PR-539.
  • Fix possible race condition in connection pool, see PR-561.
  • Fix default connection timeout, see PR-563.
  • Add lock for compressionProviders to fix data race problem, see PR-533.
  • Fix send goroutine blocked, see PR-530.

[0.5.0] 2021-05-14

Feature

  • Add http lookup service support, see PR-510.
  • Support listener name for go the client, see PR-502.
  • Add multiple hosts support, see PR-484.
  • Improve error log for frame size too big and maxMessageSize, see PR-459.
  • Update jwt-go version to v4, see PR-481.

Improve

  • Fix range channel deadlock error, see PR-499.
  • Add sentAt when put item into pendingQueue, see PR-509.
  • Fix race condition/goroutine leak in partition discovery goroutine, see PR-474.
  • Close cnxPool when closing a Client, see PR-494.
  • Use newError to build return error, see PR-471.
  • Move GetPartitionedTopicMetadata to lookup service, see PR-478.
  • Fix wrong batch flush method bug, see PR-476.
  • Fix reader with start latest message id inclusive, see PR-467.
  • Fix unexpected nil pointer when reading item from keyring, see PR-470.
  • Reverted datadog to DataDog, see PR-465.

[0.4.0] 2021-02-09

Feature

  • Support send timeout in Producer side, see PR-394.
  • Add metric for internal publish latency, see PR-397.
  • Add key_based Batch logic, see PR-363.
  • Add error label to publish errors metric, see PR-405.
  • Add const client label to metrics, see PR-406.
  • Attach topic and custom labels to Prometheus metrics, see PR-410.
  • Add orderingKey apis, see PR-427.
  • Support jwt and trusted cert for pulsar perf client, see PR-427.

Improve

  • Fix bot action CI yaml file, see PR-395.
  • Update go-keyring to v1.1.6 to remove warnings on MacOS Catalina+ , see PR-404.
  • Read the clock fewer times during message routing, see PR-372.
  • Close dangling autoDiscovery goroutine in consumer, see PR-411.
  • Fix discard unacked messages, see PR-413.
  • Fixed logic to attempt reconnections to same broker, see PR-414.
  • Reduce the default TCP connection timeout from 30 to 5 seconds, see PR-415.
  • Removed unused import "C" statement, see PR-416.
  • Renamed Metrics.RpcRequestCount to RPCRequestCount to conform to style check, see PR-417.
  • Fix leaked nack tracker goroutine, see PR-418.
  • Clearing message queues after seek requests, see PR-419.
  • Fix retry policy not effective with partitioned topic, see PR-425.
  • Deduplicate user provided topics before using them, see PR-426.
  • The reader.HasNext() returns true on empty topic, see PR-441.
  • Upgrade gogo/protobuf to 1.3.2, see PR-446.
  • Fix logrusWrapper shrink interfaces slice into an interface, see PR-449.
  • Logging what really caused lookup failure, see PR-450.
  • Make state thread safe in consumer_partition and connection, see PR-451.
  • Fix KeyFileTypeServiceAccount not found compile error, see PR-455.
  • Fix unsubscribe blocked when consumer is closing or has closed, see PR-457.
  • The asynchronized send timeout checking without pending queue lock, see PR-460.

[0.3.0] 2020-11-11

Feature

  • Support retry letter topic in Go client, see PR-359.
  • Support limit the retry number of reconnectToBroker, see PR-360.
  • Support key shared policy in Go client, see PR-363.
  • Add schema logic in producer and consumer, see PR-368.

Improve

  • Fix panic on receiverQueueSize set to -1, see PR-361.
  • Fix may lead to panic test case, see PR-369.
  • Send delay message individually even batching is enabled, see PR-372.
  • Fixed buffer resize when writing request on connection, see PR-374.
  • Fixed deadlock in DLQ ack processing, see PR-375.
  • Fix deadlock when connection closed, see PR-376.
  • Fix producer deadlock after write failure, see PR-378.
  • Fix maxMessageSize not effective even if aligned with broker, see PR-381.
  • Update default router to switch partition on all batching thresholds, see PR-383.
  • Replaced github.com/DataDog/zstd with github.com/datadog/zstd, see PR-385.
  • Fix retry policy not effective with non-FQDN topics, see PR-386.

[0.2.0] 2020-08-28

Feature

  • Expose BatchingMaxSize from ProducerOptions, see PR-280.
  • Allow applications to configure the compression level, see PR-290.
  • Support producer name for Message, see PR-299.
  • Support oauth2 authentication for pulsar-client-go, see PR-313.
  • Add interceptor feature for Go client, see PR-314.
  • Export client metrics to Prometheus, see PR-317.
  • Add Name method to Consumer interface, see PR-321.
  • Add oauth2 to the provider, see PR-338.
  • Support specified the oauth2 private key with prefix file:// and data://, see PR-343.
  • Fix the keyfile unmarshal error, see PR-339.
  • Add a new method to create auth provider from tls cert supplier, see PR-347.
  • Add seek logic for reader, see PR-356.

Improve

  • Use .asf.yaml to configure github repo, see PR-216.
  • Auto update the client to handle changes in number of partitions, see PR-221.
  • Clean callbacks of connection after run loop stopped, see PR-248.
  • Fix unable to close consumer after unsubscribe in Shared Subscription, see PR-283.
  • Introduced lifecycle for compression providers, see PR-284.
  • Use maxPendingMessages for sizing producer eventsChan, see PR-285.
  • Avoid contention on producer mutex on critical path, see PR-286.
  • Switched to DataDog zstd wrapper, reusing the compression ctx, see PR-287.
  • Fix panic when creating consumer with ReceiverQueueSize set to -1, see PR-289.
  • Used pooled buffering for compression and batch serialization, see PR-292.
  • Use gogofast to have in-place protobuf serialization, see PR-294.
  • Added semaphore implementation with lower contention, see PR-298.
  • Fixed pooled buffer lifecycle, see PR-300.
  • Removed blocking queue iterator, see PR-301.
  • Fix panic in CreateReader API using custom MessageID for ReaderOptions, see PR-305.
  • Change connection failed warn log to error and print error message, see PR-309.
  • Share buffer pool across all partitions, see PR-310.
  • Add rerun feature test command to repo, see PR-311.
  • Fix CompressMaxSize() for ZLib provider, see PR-312.
  • Reduce the size of the MessageID structs by one word on 64-bit arch, see PR-316.
  • Do not allocate MessageIDs on the heap, see PR-319.
  • Different MessageID implementations for message Production and Consumption, see PR-324.
  • Fix producer block when the producer with the same id, see PR-326.
  • Get the last message when LatestMessageID and inclusive, see PR-329.
  • Fix go.mod issue with invalid version, see PR-330.
  • Fix producer goroutine leak, see PR-331.
  • Fix producer state by reconnecting when receiving unexpected receipts, see PR-336.
  • Avoid producer deadlock on connection closing, see PR-337.

Contributors

Our thanks go to the following contributors from the community for helping this release:

[0.1.1] 2020-06-19

Improve

Contributors

Our thanks go to the following contributors from the community for helping this release:

[0.1.0] 2020-03-24

New Feature

Client

  • Support TLS logic
  • Support Authentication logic
  • Support Proxy logic
  • Support Hostname verification logic

Producer

  • Add Send() method in Producer interface
  • Add SendAsync() method in Producer interface
  • Add LastSequenceID() method in Producer interface
  • Add Flush() method in Producer interface
  • Add Close() method in Producer interface
  • Add Topic() method in Producer interface
  • Add Name() method in Producer interface
  • Support MessageRouter logic
  • Support batch logic
  • Support compression message logic
  • Support HashingScheme logic
  • Support User defined properties producer logic

Consumer

  • Add Subscription() method in Consumer interface
  • Add Unsubscribe() method in Consumer interface
  • Add Receive() method in Consumer interface
  • Add Ack() method in Consumer interface
  • Add AckID() method in Consumer interface
  • Add Nack() method in Consumer interface
  • Add NackID() method in Consumer interface
  • Add Seek() method in Consumer interface
  • Add SeekByTime() method in Consumer interface
  • Add Close() method in Consumer interface
  • Support Dead Letter Queue consumer policy
  • Support Topics Pattern and Topics logic
  • Support topic consumer regx logic
  • Support multi topics consumer logic
  • Support Exclusive, Failover, Shared and KeyShared subscribe type logic
  • Support Latest and Earliest logic
  • Support ReadCompacted logic
  • Support ReplicateSubscriptionState logic
  • Support User defined properties consumer logic
  • Support Delayed Delivery Messages logic

Reader

  • Add Topic() method in Reader interface
  • Add Next() method in Reader interface
  • Add HasNext() method in Reader interface
  • Add Close() method in Reader interface
  • Support read compacted logic
  • Support start messageID logic
  • Support User defined properties reader logic

Contributors

Our thanks go to the following contributors from the community for helping this release: