Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

improve performance of resource-list in sql #1

Open
wants to merge 5,042 commits into
base: master
Choose a base branch
from

Conversation

kleopatra999
Copy link
Owner

simplify the query to retrieve list of resources. it is much simpler
to query against raw Sample data then to join against Resource table.

also, add meter_links param to allow ability to disable link generation of
relate meters.

Change-Id: Ia4ceafc568c4a2e4c8e6b7586511135627b9335e
Closes-Bug: #1264434
Implements: blueprint big-data-sql

Zuul and others added 30 commits June 23, 2022 06:39
This parameter has had no effect for several cycles and was officially
deprecated during Xena cycle[1].

[1] 46ad278

Related-Bug: #1929178
Change-Id: I8463537ca09db2f0bc443505afaab6a1f9ff5db2
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: I3032791712499ccbef4e0feba846cf0fa44374be
The iso8601_from_timestamp function from oslo_utils.timeutils was
deprecated in oslo_utils 1.6.0[1] and was removed in 6.0.0[2].

[1] 5cad113739fa906c3901e530fcbfdee3b48961c1
[2] 76146aaca88c830c298de31ba1ead00dd63ce4c4

Change-Id: I1e3d210c4e9aae9b1c248ce88aabd6344fd87761
... and discovery/inspector plugins depending on the pollster. These
were implemented to gather metrics via SNMP daemon in TripleO-managed
deployment but these are no longer valid since Telemetry services and
Nova were removed from undercloud.

Change-Id: If9a6b695ba799c766314a88328ea8a779407acc0
The oslotest package distributes a shell file that may be used to assist
in debugging python code. The shell file uses testtools, and supports
debugging with pdb.

To enable debugging, run tox with the debug environment. Below are the
following ways to run it.

 * tox -e debug module
 * tox -e debug module.test_class
 * tox -e debug module.test_class.test_method

Signed-off-by: Yadnesh Kulkarni <ykulkarn@redhat.com>
Change-Id: I7015ab52ba3f5075b5e06992bb8d72f52104a24e
Replace abc.abstractproperty with property and abc.abstractmethod,
as abc.abstractproperty has been deprecated since python3.3[1]

[1]https://docs.python.org/3.8/whatsnew/3.3.html?highlight=deprecated#abc

Change-Id: Ie96896399304c6ac1a3f38900aa6695d56f2c5ca
A unicode prefix is meaningless in Python 3. Because now ceilometer
supports only Python 3, we can remove the prefix.

Change-Id: I7bc91be21df646d8bbc7793eec28a93179a3eefa
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: I48d1633a24b0ccf1e6a7517956ca7f2dbe2fdb15
The -fips job was repaired in [1]. Build history [2] shows the job
passing again.

[1] openstack/telemetry-tempest-plugin@935428a
[2] https://zuul.opendev.org/t/openstack/builds?job_name=telemetry-dsvm-integration-centos-9s-fips

Change-Id: I3df2261d6927be41a895be41940d3de4302cc05b
Problem description
===================
The dynamic pollsters only support APIs that produce
JSON responses. Therefore the dynamic pollsters do not
support APIs where the response is an XML or not Restful
compliant APIs with HTTP 200 within a plain text message
on errors.

Proposal
========
To allow the dynamic pollsters to support other APIs
response formats, we propose to add a response handling
that supports multiple response types. It must be
configurable in the dynamic pollsters YAML. The default
continues to be JSON.

Change-Id: I4886cefe06eccac2dc24adbc2fad2166bcbfdd2c
The oslo.cache library is now included in the requirements thus should
be always installed. This change removes the logic to handle missing
oslo.cache.

Change-Id: I1cc09aa0db5f19e913030b528c51052fd4ef331d
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: I6673a4d274dc1288d14e0dfa9551015629724b55
Upon installing ceilometer and gnocchi using devstack,
"filter_project" in "pipeline.yaml" is set to "gnocchi_swift"
project. However, no such project exists in keystone.
```
publishers:
  - gnocchi://?archive_policy=ceilometer-low&filter_project=gnocchi_swift
```

This change, will set "filter_project" to "service" project which
will exclude all metrics from it.

Also add the name of the project to the logs which couldn't be found
in keystone.

Closes-Bug: #1988923
Signed-off-by: Yadnesh Kulkarni <ykulkarn@redhat.com>
Change-Id: Ifc215f86134729665c142bb9bf64f66ca8de2a29
There was a problem with the barbican credentials processing for
Non-OpenStack dynamic pollster. The credentials variables would be
retrieved as a byte string, which would break the processing.
Therefore, we needed to introduce a method to check if the credentials
are a String object. if they are not, we convert them to String.

Change-Id: I2084061eb8f543d4c557963599732e35cfa22996
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: Ic9c0538faa9f5ec39f35ad98ee33efc14d218618
Add file to the reno documentation build to show release notes for
stable/zed.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/zed.

Sem-Ver: feature
Change-Id: Ib283c78f335ce25c35fb18f142a2abe970bd7f4e
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for antelope. Also,
updating the template name to generic one.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ibf8a7ba2bed10e90fc6acb7693055489c170ec03
kajinamit and others added 30 commits October 3, 2024 18:11
... because pkg_resources was removed in Python 3.12 .

Change-Id: Ib0de144da9d1933ea63aea585df4832c69d7c2fb
Notifications are not always sent over RabbitMQ solely and may be done
by different methods according to how the notification driver is
configured.

Change-Id: I31e12b9ab421f44ef51040f83ff99514c9dd7c9e
Allow generating GMR report upon file trigger in addition to a signal.

The feature has been available in oslo.reports since 1.11.0[1] but it
can't be used in ceilometer without proper initialization.

[1] d23e0a65b23dc77d0104075d2313de6ca22b5cae

Change-Id: Ib08a808cff3203aa90c91e3bc25c3d46a14f0ade
These files can't be validated in CI. Skip the functional tests to
avoid unnecessary CI run.

Change-Id: I3bc474fe4dc48a427434569f31b613f31b965175
This is adding a similar functionality which was introduced
in https://review.opendev.org/c/openstack/ceilometer/+/926176

Change-Id: Ic06841f3f73736d7124d6fa1e6668613ba9ce309
This changes the code to follow the original code in sg-core.
The resource_name label value in sg-core is being overwritten
when there is a "display name" and "name". It shouldn't be
duplicated.

It also removes the index variable, which is there in the
original implementation mostly to do this overwrite. I
don't think it's needed in this Python implementation.

Related sg-core code: https://github.com/infrawatch/sg-core/blob/master/plugins/handler/ceilometer-metrics/main.go#L269

Change-Id: I72971d51fa37b43e348605af9f6bb52cfa651369
It was added as part of maintenance of lower-constraints[1], but is not
really used by our code directly.

[1] 7a994d0

Change-Id: I2f83ad8cc7433a918f248c432f3506ea3d0e2de2
This existing logic is quite redundant and most of the checks in if
block can be replaced by `if dict['key']:`.

Change-Id: I6c36c7263e8d305afa6e4859d902c13e512d0448
Each sample is processed according to its type. So usage of
an unsupported type may cause some samples to be ignored unexpectedly.

Make sure that the Sample class is initialized with a supported value
to detect any internal bugs.

Change-Id: Iadcd9654d823b7c60d6f10d1f9b67877cbc9183a
Python 3.8 is no longer part of the tested runtimes since 2024.2[1]
because its EOL is coming soon.

Also officially declare python 3.12 support because python 3.12 is now
part of tested runtimes and unit test job with Python 3.12 is now
voting.

[1] https://governance.openstack.org/tc/reference/runtimes/2024.2.html

Change-Id: I472c27133b59c18e08d60f112bb6a77c8bc9d4a8
Change-Id: Idc182aad89cc963384d2752f775e03acb682e2cc
This patch fixes the gate, which is currently broken.

Change-Id: Iaf235e7313e8cf874fc0fca9296eda2b5436d227
without this, ceilometer will only ever work with public endpoint
of Identity API v3, which does not work for some network topologies.

Change-Id: I00b7e420fcfce11f7c245a73ab1d007f939f74ad
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.