ObjectDisposedException when re-instantiating the consumer while Consume()

Description
What's the best way to re-initialize the consumer instance cleanly while the consumer.Consume(cancellationToken) method is still fetching messages?
Running consumer as a ASP.Net Hosted service. My use case, is that the SSL certificate renews every 24 hours. Once that happens, I trigger the OnChange() on the strongly typed IOptionsMonitor<> which does the following:
protected override void BuildConsumer()
{
    _consumer?.Close();
    _consumer = _consumerBuilder.Build(() => Provider);
}

protected override Task ExecuteAsync(CancellationToken cancellationToken) =>
    Task.Run(async () =>
    {
        _consumer.Subscribe(_topicService.GetOrderTopic(Provider));

        while (!cancellationToken.IsCancellationRequested)
        {
            try
            {
                var result = _consumer.Consume(cancellationToken);
                if (result.IsPartitionEOF)
                {
                    return;
                }

                var message = result.Message.Value;
                // Process message here
            }
            catch (OperationCanceledException) { /* Log exception here */ }
            catch(ConsumeException exception) when (NonFatalException(exception, () => _logger.LogError(exception, exception.Message)))
            {

            }
        }
    }, cancellationToken);

Implementation of the ConsumerBuilder is as follows:
public class KafkaConsumerBuilder: IKafkaConsumerBuilder
{
    #region Fields

    private readonly KafkaOptions _kafkaOptions;
    private readonly IOptionsMonitor<SslOptions> _sslOptions;
    private readonly ILogger _logger;

    #endregion

    #region Constructors

    /// <summary>
    /// Initializes a new instance of the <see cref="KafkaConsumerBuilder"/> class
    /// </summary>
    /// <param name="sslOptions">SSL configuration options</param>
    /// <param name="kafkaOptions">Kafka configuration options</param>
    /// <param name="logger">Class logger</param>
    public KafkaConsumerBuilder(IOptionsMonitor<SslOptions> sslOptions,
        IOptions<KafkaOptions> kafkaOptions,
        ILogger<KafkaConsumerBuilder> logger)
    {
        _sslOptions = sslOptions ?? throw new ArgumentNullException(nameof(sslOptions));
        _kafkaOptions = kafkaOptions?.Value ?? throw new ArgumentNullException(nameof(kafkaOptions));
        _logger = logger;
    }

    #endregion

    #region Implementation of IKafkaConsumerBuilder

    /// <inheritdoc />
    public IConsumer<string, IKafkaRequest> Build(Func<string> providerFunc)
    {
        var config = CreateConfiguration(providerFunc());
        return new ConsumerBuilder<string, IKafkaRequest>(config)
            .SetValueDeserializer(new CommandDeserializer())
            .SetErrorHandler((_, error) =>
            {
                if (error.IsFatal)
                {
                    _logger.LogError("{@Error}", error);
                }

                if (error.Code == ErrorCode.Local_Ssl || error.Code == ErrorCode.Local_Authentication)
                {
                    _logger.LogError("SSL error: {@Error}", error);
                }
            })
            .SetLogHandler((_, message) =>
            {
                _logger.LogDebug("{@Message}", message);
            })
            .SetOffsetsCommittedHandler((_, offsets) =>
            {
                _logger.LogInformation("Offsets committed: {@Offsets}", offsets);
            })
            .Build();
    }

    #endregion

    #region Private members

    /// <summary>
    /// Creates the configuration for kafka consumer
    /// </summary>
    /// <returns>Consumer configuration</returns>
    private ConsumerConfig CreateConfiguration(string provider) =>
        new ConsumerConfig
        {
            BootstrapServers = _kafkaOptions.BootstrapServers,
            SecurityProtocol = SecurityProtocol.Ssl,
            SslCertificatePem = _sslOptions.CurrentValue.Certificate,
            SslKeyPem = _sslOptions.CurrentValue.PrivateKey,
            Debug = "consumer,cgrp,topic,fetch",
            EnablePartitionEof = true,
            EnableAutoCommit = true,
            EnableAutoOffsetStore = false,
            AutoCommitIntervalMs = 1000,
            AutoOffsetReset = AutoOffsetReset.Earliest,
            GroupId = $"{provider}-consumers"
        };

    #endregion
}

How to reproduce
If BuildConsumer() gets called while the Consume() method is fetching messages, I get an ObjectDisposedException.
Question
How can I handle this use case? Any pointers are most appreciated
Checklist
Please provide the following information:

[x] A complete (i.e. we can run it), minimal program demonstrating the problem. No need to supply a project file.
[x] Confluent.Kafka nuget version: 1.5.2
[ ] Apache Kafka version.
[ ] Client configuration.
[x] Operating system: Windows Server 2016
[ ] Provide logs (with "debug" : "..." as necessary in configuration).
[ ] Provide broker log excerpts.
[ ] Critical issue.

don't have the bandwidth to provide code, but everything needs to happen serially - you can't dispose the consumer whilst it is consuming. Cancel the Consume, dispose the consumer, then create a new consumer.

don't have the bandwidth to provide code, but everything needs to happen serially - you can't dispose the consumer whilst it is consuming. Cancel the Consume, dispose the consumer, then create a new consumer.

Thanks @mhowlett. That's the recommendation I was after. Will give this a try.

Thanks @mhowlett. That's the recommendation I was after. Will give this a try.


ci: Temporarily disable docs link check to unblock PRs

I am unsure how to fix this error so temporarily disable this so that other PRs can be merged.
https://github.com/argoproj/argo-workflows/actions/runs/4406056997/jobs/7717770785
/opt/hostedtoolcache/node/19.7.0/x64/lib/node_modules/markdown-link-check/node_modules/async/dist/async.js:324
            if (fn === null) throw new Error("Callback was already called.");
                             ^

Error: Callback was already called.
    at /opt/hostedtoolcache/node/19.7.0/x64/lib/node_modules/markdown-link-check/node_modules/async/dist/async.js:324:36
    at /opt/hostedtoolcache/node/19.7.0/x64/lib/node_modules/markdown-link-check/node_modules/async/dist/async.js:248:17
    at /opt/hostedtoolcache/node/19.7.0/x64/lib/node_modules/markdown-link-check/index.js:129:13
    at /opt/hostedtoolcache/node/19.7.0/x64/lib/node_modules/markdown-link-check/node_modules/link-check/lib/proto/http.js:117:21
    at done (/opt/hostedtoolcache/node/19.7.0/x64/lib/node_modules/markdown-link-check/node_modules/needle/lib/needle.js:463:14)
    at PassThrough.<anonymous> (/opt/hostedtoolcache/node/19.7.0/x64/lib/node_modules/markdown-link-check/node_modules/needle/lib/needle.js:717:9)
    at PassThrough.emit (node:events:524:35)
    at endReadableNT (node:internal/streams/readable:1359:12)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)

I think this can be permanent.

Thank you @terrytangyuan


Major refresh 2024/2025

I am thinking of a major refresh to the UI/Site for Script Samples.
UI

New Theme - Currently, I am working on a skin for DocFx in the format of the main pnp.github.io site - WIP is here:  https://pkbullock.github.io/pnp-docfx-theme/ its not finished but visually could look like the new site.
List view - have a view to see all the scripts in a list rather than card view.
Tabs - I'm thinking of moving away from the tab experience and having all the scripts within the page, perhaps with jump links e.g. for those samples, with PnP Powershell, Cli for Microsoft 365 etc.
Script Category Refresh e.g. Intranet, DMS, Search Project, Copilot, Security, to better see what scripts are available by users intended project. This will need to align in some part with the adoption gallery.

Contributor Experience
I'm thinking of ways to lower the barrier to contribution

Contributor guidance refresh
Video examples
Even considering a UI experience to collect the script and visually generate the page, then on save, create a PR.
At the moment, I am the only one who can see if the pages/site generates as expected, which isn't optimal, something I do manually and locally. I might see what can be done about a "preview" of the site or sample with your submission.
Optionally, have a request to generate the description of the script using AI.

Sample Checking

This one might be challenging but to check, and refresh samples to the latest versions of their samples (or have a tested new tweaked sample) I wonder based on sample complexity which ones can be "automated" vs manual due to very specific setup.

Ref Issues that might feed into this: #638, #681, #522, #511, #284, #182, #95 and try incorporate or make redundant these issues.
Open to all to comment, if there is something you would like to see.
CC: @reshmee011, @kasperbolarsen, @chandaniprajapati, @ValerasNarbutas - just wondering what your thoughts are, or things you would like to see.

hi @pkbullock ,

to be fare i really like clean theme we have now, but i do agree it would be better to have consistent theme.
On tabs or jump links both are quite good, as long as we still have it as separate code snippet in view,
Contributor experience is quite good at least when i show it to some potential contributors, feedback is good.
List view would be also great, (for me boxes also very convenient ), List view like this https://pnp.github.io/script-samples/matrix.html
is nice, just filter options on headers would be something i miss

I do not really have any comments on improvements, script-samples already one of the most clear displays. Very easy to the eye, intuitive UI.
Happy to help on improvements by the way,
Valeras

Hi @ValerasNarbutas - thank you for your really great feedback, and thank you for sharing your experiences with myself and other potential contributors, really cool.
The theme is quite a bit of work, so might consider your inputs, the new one is certainly different, so need to think about readability, simplicity etc. Its likely not the first (if any) improvement I would make.
The matrix link was a quick view for me to assess sample coverage and qualities for the community calls, but I see your point there. Thank you.
Appreciate the input 🤩


Document how docs are handled before and during release.

What this PR does / why we need it:
Let's try using a next-release branch for docs.
Also split the super-long lines into paragraphs for ease of diff viewing
and reading, add some markup here and there, fix some typos and reword a
couple of unclear sentences.
Signed-off-by: Marcin Owsiany<EMAIL_ADDRESS>

rebased and squashed dco violating suggestion commit


How do I use different locale

In the UCA standard's introduction they present  an example as the following

Language
Swedish:
German:

--
z < ö
ö < z

@jtauber How would I achieve this with PyUCA?
If I use the foreign C++ bindings with PyICU I can produce the above example like this
>>> def collate_compare(collator, a, b): return collator.getSortKey(a) > collator.getSortKey(b)
...
>>> col_de = Collator.createInstance(Locale("de_DE"))
>>> col_de.setStrength(Collator.PRIMARY)
>>> col_se = Collator.createInstance(Locale("sv_SE"))
>>> col_se.setStrength(Collator.PRIMARY)
>>> collate_compare(col_de, "ö", "z") # German: ö is more than z => False
False
>>> collate_compare(col_se, "ö", "z") # Swedish: ö is more than z => True
True

However, I would much prefer a pure python solution without mixing in external C++ dependencies as these make installation and usage cumbersome. I could not find any guidance in the documentation on how to achieve this goal with PyUCA so would love any help or pointers.

The way to achieve different sort orders is to use a different collation element table. PyICU must ship with different CETs for different locales.

Hm, so pyuca is only configured to uca-en and any other locale would need to download uca-xy raw files? That's not convenient (e.g. for installing pyuca from PyPI)
Perhaps pyuca could be have some sort of a switch to use different localizations and get all the files instead of the English one only?

It is not only configured for English-only. It by default uses the DUCET (which is suitable for many things beyond English). You can supply an alternative CET in the constructor.
If there are alternative CETs we could ship with, I'm happy to do that.

Well, I need specifically uca-cs (based on CLDR: https://github.com/unicode-org/cldr/tree/master/common/collation, could be tested here: http://demo.icu-project.org/icu-bin/collation.html)
I thought pyuca could help me with that.

pyuca is just an implementation of the UCA. CLDR is an extension of UCA which I haven't (yet) implemented. CLDR support could be added to pyuca or a new library could be created.

However, pyuca can still be used for locale-specific collation, you just need to manually create the appropriate CET for your locale.

I see, well, this way is not convenient for automatic testing.


MFA resource type format incorrectly documented

Based on https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_policies_examples_aws_my-sec-creds-self-manage.html the action iam:CreateVirtualMFADevice is given a Resource of arn:aws:iam::*:mfa/${aws:username}, but in the docs, this action is stated to require a resource of the format arn:${Partition}:iam::${Account}:mfa/${Path}/${MfaTokenId} (see https://docs.aws.amazon.com/IAM/latest/UserGuide/list_identityandaccessmanagement.html#identityandaccessmanagement-mfa).
The discrepancy is with the part ${aws:username} vs ${Path}/${MfaTokenId} where the latter requires a /, but the former does not.  The action iam:CreateVirtualMFADevice does not require an MFA resource with that additional / in it, and therefore the docs are incorrect.  This is in the file https://github.com/awsdocs/iam-user-guide/blob/1e13dd780146c57701c6069ba0b9bd185a6f13d6/doc_source/list_identityandaccessmanagement.md#L41

You're correct that there is not an extra required /. The example policy here is correct for iam:CreateVirtualMFADevice: https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_policies_examples_aws_my-sec-creds-self-manage.html. We need to engage with the IAM engineering team to confirm and determine what updates are required.

Any updates on this?

We sent a ticket to the engineering team and we are awaiting their feedback.

Any updates on this?

I have requested an updated status from the engineering teams involved with this request.

Apologies for the long delay. The MFA resource ARN format has now been updated. Thanks so much for reporting this.


Transform datafields should be inline on map files

It lets you save an extra line per transformcomponent for stonks.
So
- proto: Window
  entities:
  - uid: 37
    components:
    - pos: 0.5,-2.5
      parent: 181
      type: Transform
  - uid: 46
    components:
    - pos: -5.5,-1.5
      parent: 181
      type: Transform

becomes
- proto: Window
  entities:
  - uid: 37
    pos: 0.5,-2.5
    parent: 181
  - uid: 46
    pos: -5.5,-1.5
    parent: 181

(where no comps found which is 90% of entities you also save the extra line).

Are these changes really worth the effort? This is just saving file size, right?
If the maps are compressed (git), a change like this would barely matter.

Makes diffs smaller, idc as much about file size.

But I guess now that decals are deterministic it's less of an issue.


Git Bash launches into external terminal when set as integrated terminal for windows VSCode version 1.79.0

Does this issue occur when all extensions are disabled?: Yes

VS Code Version: 1.79.0
OS Version: Windows_NT x64 10.0.19045

Steps to Reproduce:

Set Git bash as the default integrated terminal for Windows
From the menu select Terminal -> New Terminal
Git Bash opens outside of VS Code in an external Git Bash command prompt and an empty, non-interactive console remains open in VS Code

I just took this latest update for VS Code (1.79.0) and this started happening.  Here is how my settings are for integrated terminal in settings.json:
"terminal.integrated.defaultProfile.windows": "Git Bash",
"terminal.external.windowsExec": "",
"terminal.integrated.automationProfile.windows": null,
"terminal.integrated.profiles.windows": {
"Git Bash": {
"source": "Git Bash",
"path": "C:\Program Files\Git\git-bash.exe"
}
}
I updated Git to version 2.39.1-1.0.0 to see if that would fix and it did not.
Selecting Windows normal command prompt and PowerShell still work as integrated terminals.

What happens if you remove this:
"terminal.external.windowsExec": "",

/duplicate #184674

"path": "C:\Program Files\Git\git-bash.exe"

That worked!  Thank you!


psqlpy slower than psycopg

I made my own benchmark between psqlpy vs psycopg you can found the comparison and code in this github repo https://github.com/BimaAdi/psqlpy-vs-psycopg. I made 2 use case

Insert bulk (insert many data in one transaction)
Get many (get many data from database)

I found that psqlpy is slower than psycopg. Here the result (all in second):
Insert Bulk Time

psqlpy
psycopg

1
0.271
0.096

2
0.269
0.184

3
0.319
0.216

4
0.38
0.097

5
0.378
0.117

6
0.288
0.139

7
0.287
0.159

8
0.267
0.101

9
0.285
0.107

10
0.448
0.181

avg
0.319
0.14

Get Bulk Time

psqlpy
psycopg

1
0.002
0.002

2
0.005
0.003

3
0.004
0.004

4
0.002
0.002

5
0.005
0.002

6
0.002
0.002

7
0.002
0.003

8
0.003
0.002

9
0.003
0.002

10
0.003
0.002

avg
0.003
0.002

Machine spec

intel core i7 9th gen
16 gb RAM
SSD

Although by only small margin but psycopg consitently beat psqlpy. What's wrong with my benchmark? did I do something wrong? or maybe due to other factor?

Hello! Thank you for you benchmarks.
But, I've found some strange moments.
First of all, let's see my results:
insert bulk time
shape: (11, 3)
|     | psqlpy | psycopg |
| --- | ---    | ---     |
| str | f64    | f64     |
|-----|--------|---------|
| 1   | 0.027  | 0.034   |
| 2   | 0.025  | 0.024   |
| 3   | 0.024  | 0.023   |
| 4   | 0.022  | 0.021   |
| 5   | 0.022  | 0.021   |
| 6   | 0.022  | 0.021   |
| 7   | 0.023  | 0.02    |
| 8   | 0.022  | 0.021   |
| 9   | 0.023  | 0.021   |
| 10  | 0.024  | 0.021   |
| avg | 0.023  | 0.023   |
get bulk time
shape: (11, 3)
|     | psqlpy | psycopg |
| --- | ---    | ---     |
| str | f64    | f64     |
|-----|--------|---------|
| 1   | 0.001  | 0.001   |
| 2   | 0.001  | 0.001   |
| 3   | 0.001  | 0.001   |
| 4   | 0.001  | 0.001   |
| 5   | 0.001  | 0.001   |
| 6   | 0.001  | 0.001   |
| 7   | 0.001  | 0.001   |
| 8   | 0.001  | 0.001   |
| 9   | 0.001  | 0.001   |
| 10  | 0.001  | 0.001   |
| avg | 0.001  | 0.001   |

They are approximately the same. I'll make sure to explain why.
So, what I found strange?

In inserting new rows with psqlpy, you don't really use a transaction.
https://github.com/BimaAdi/psqlpy-vs-psycopg/blob/main/bench_psqlpy.py#L29
This method is asynchronous
Using the old version of PostgreSQL. As I see, you are using the 12 version, I didn't perform any tests on the 12th version of PostgreSQL.
So the question is why is so old?

The correct (for you test) PSQLPy bench function is:
async def bench() -> BenchTypedDict:
    bench_time: BenchTypedDict = {"insert_bulk_time": 0.0, "get_bulk_time": 0.0}
    try:
        db_pool = (
            ConnectionPoolBuilder()
            .user(POSTGRESQL_USER)
            .password(POSTGRESQL_PASSWORD)
            .host(POSTGRESQL_HOST)
            .port(POSTGRESQL_PORT)
            .dbname(POSTGRESQL_DATABASE)
            .build()
        )

        async with db_pool.acquire() as connection:
            async with connection.transaction() as trans:
                await create_table(trans)

                start = time()
                await insert_bulk(trans)
                end = time() - start
                bench_time["insert_bulk_time"] = end

                start = time()

                await get_bulk(trans)
                end = time() - start
                bench_time["get_bulk_time"] = end

                await drop_table(trans)
    finally:
        db_pool.close()

The main explanation:
PSQLPy aims to give you performance in real high-load applications at first, because of how rust (tokio runtime) manages asynchronous tasks.
Let's imagine what is happening in the test you made, you always have 1 connection that is perfectly connected to the PostgreSQL, and all that drivers must do is request the database and get results. There is practically no window for optimization.
On the other hand, when you have a lot of asynchronous requests to the database, it's important how the driver manages the connection pool and how a programming language manages the event loop tasks.

I've made test with the 12th version of PostgreSQL (from you docker-compose).
shape: (11, 3)
|     | psqlpy | psycopg |
| --- | ---    | ---     |
| str | f64    | f64     |
|-----|--------|---------|
| 1   | 0.029  | 0.045   |
| 2   | 0.026  | 0.027   |
| 3   | 0.024  | 0.024   |
| 4   | 0.025  | 0.023   |
| 5   | 0.025  | 0.025   |
| 6   | 0.025  | 0.025   |
| 7   | 0.021  | 0.023   |
| 8   | 0.024  | 0.024   |
| 9   | 0.028  | 0.023   |
| 10  | 0.027  | 0.026   |
| avg | 0.025  | 0.027   |
get bulk time
shape: (11, 3)
|     | psqlpy | psycopg |
| --- | ---    | ---     |
| str | f64    | f64     |
|-----|--------|---------|
| 1   | 0.0    | 0.001   |
| 2   | 0.0    | 0.0     |
| 3   | 0.0    | 0.0     |
| 4   | 0.0    | 0.0     |
| 5   | 0.0    | 0.0     |
| 6   | 0.0    | 0.0     |
| 7   | 0.0    | 0.0     |
| 8   | 0.0    | 0.0     |
| 9   | 0.0    | 0.0     |
| 10  | 0.0    | 0.0     |
| avg | 0.0    | 0.0     |

@BimaAdi If you dont mind, I can transfer the issue to discussions cuz it's not really an issue, more like discussion. If we'll find really downsides of PSQLPy, I'll be happy to improve performance.

@chandr-andr  Ok, I don't mind is this issue become a discussion. I made this issue because there is 0 discussion on discussion tab and i read this issue https://github.com/qaspen-python/psqlpy/issues/43 about benchmark as well.

Yeap, I understand. Library is young (4.5 months), so there are no a lot of activity yet


Update telegram-alpha to 3.6-110130,730

After making all changes to the cask:

[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} left no offenses.
[x] The commit message includes the cask’s name and version.

731 is out.

Closing in favour of https://github.com/caskroom/homebrew-versions/pull/4917


Set up views for app

@primeXXIX please add yourself to prr at prrr.learnersguild.org so that I can assign myself to this PR. Also @primeXXIX @lizzkats I see that this has already been merged and deleted already. Does this mean you don't want a review on it anymore?

@moniarchy- I do want a review I just usually merge my commits and implement feedback on the next commit so that I don't have merge conflicts

I'd definitely recommend getting a review before merging so that the work you do for a particular branch really stays specific to that one branch. Either way, still super happy to give a review, but can your teammate log into prrr so I can self assign myself as a reviewer?

I will remind him when he's back :) Thanks Monica


US1143863: Update query definition to include field projection

Purpose
US1143863: Update query definition to include field projection

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Update mrlearning-base-ch5.md

Docs Build status updates of commit b3fd377:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

mixed-reality-docs/mrlearning-base-ch5.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


error when run "roslaunch realsense2_camera rs_camera.launch"

Required Info

Camera Model
{  D455 }

Firmware Version
(<IP_ADDRESS>/5.12.7)

Operating System & Version
{ Linux (Ubuntu 18.04lts)

Kernel Version (Linux Only)
(5.4.0-42-generic)

Platform
PC

SDK Version
{ RealSense ROS v2.2.16 Built with LibRealSense v2.36.0Running with LibRealSense v2.37.0 }

Language
{C/C#/labview/nodejs/opencv/pcl/python/unity }

Segment
{Robot/Smartphone/VR/AR/others }

Issue Description
dw@dw:~$ roslaunch realsense2_camera rs_from_file.launch
... logging to /home/dw/.ros/log/dd9f527e-e2c9-11ea-8b7b-98fa9bae5cf3/roslaunch-dw-5794.log
Checking log directory for disk usage. This may take a while.
Press Ctrl-C to interrupt
Done checking log file disk usage. Usage is <1GB.
started roslaunch server http://dw:38675/
SUMMARY
PARAMETERS

/camera/realsense2_camera/accel_fps: 0
/camera/realsense2_camera/accel_frame_id: camera_accel_frame
/camera/realsense2_camera/accel_optical_frame_id: camera_accel_opti...
/camera/realsense2_camera/align_depth: False
/camera/realsense2_camera/aligned_depth_to_color_frame_id: camera_aligned_de...
/camera/realsense2_camera/aligned_depth_to_fisheye1_frame_id: camera_aligned_de...
/camera/realsense2_camera/aligned_depth_to_fisheye2_frame_id: camera_aligned_de...
/camera/realsense2_camera/aligned_depth_to_fisheye_frame_id: camera_aligned_de...
/camera/realsense2_camera/aligned_depth_to_infra1_frame_id: camera_aligned_de...
/camera/realsense2_camera/aligned_depth_to_infra2_frame_id: camera_aligned_de...
/camera/realsense2_camera/allow_no_texture_points: False
/camera/realsense2_camera/base_frame_id: camera_link
/camera/realsense2_camera/calib_odom_file:
/camera/realsense2_camera/clip_distance: -1.0
/camera/realsense2_camera/color_fps: 0
/camera/realsense2_camera/color_frame_id: camera_color_frame
/camera/realsense2_camera/color_height: 0
/camera/realsense2_camera/color_optical_frame_id: camera_color_opti...
/camera/realsense2_camera/color_width: 0
/camera/realsense2_camera/depth_fps: 0
/camera/realsense2_camera/depth_frame_id: camera_depth_frame
/camera/realsense2_camera/depth_height: 0
/camera/realsense2_camera/depth_optical_frame_id: camera_depth_opti...
/camera/realsense2_camera/depth_width: 0
/camera/realsense2_camera/device_type:
/camera/realsense2_camera/enable_accel: True
/camera/realsense2_camera/enable_color: True
/camera/realsense2_camera/enable_depth: True
/camera/realsense2_camera/enable_fisheye1: False
/camera/realsense2_camera/enable_fisheye2: False
/camera/realsense2_camera/enable_fisheye: True
/camera/realsense2_camera/enable_gyro: True
/camera/realsense2_camera/enable_infra1: True
/camera/realsense2_camera/enable_infra2: True
/camera/realsense2_camera/enable_infra: False
/camera/realsense2_camera/enable_pointcloud: False
/camera/realsense2_camera/enable_pose: False
/camera/realsense2_camera/enable_sync: False
/camera/realsense2_camera/filters:
/camera/realsense2_camera/fisheye1_frame_id: camera_fisheye1_f...
/camera/realsense2_camera/fisheye1_optical_frame_id: camera_fisheye1_o...
/camera/realsense2_camera/fisheye2_frame_id: camera_fisheye2_f...
/camera/realsense2_camera/fisheye2_optical_frame_id: camera_fisheye2_o...
/camera/realsense2_camera/fisheye_fps: 0
/camera/realsense2_camera/fisheye_frame_id: camera_fisheye_frame
/camera/realsense2_camera/fisheye_height: 0
/camera/realsense2_camera/fisheye_optical_frame_id: camera_fisheye_op...
/camera/realsense2_camera/fisheye_width: 0
/camera/realsense2_camera/gyro_fps: 0
/camera/realsense2_camera/gyro_frame_id: camera_gyro_frame
/camera/realsense2_camera/gyro_optical_frame_id: camera_gyro_optic...
/camera/realsense2_camera/imu_optical_frame_id: camera_imu_optica...
/camera/realsense2_camera/infra1_frame_id: camera_infra1_frame
/camera/realsense2_camera/infra1_optical_frame_id: camera_infra1_opt...
/camera/realsense2_camera/infra2_frame_id: camera_infra2_frame
/camera/realsense2_camera/infra2_optical_frame_id: camera_infra2_opt...
/camera/realsense2_camera/infra_fps: 0
/camera/realsense2_camera/infra_height: 0
/camera/realsense2_camera/infra_width: 0
/camera/realsense2_camera/initial_reset: False
/camera/realsense2_camera/json_file_path:
/camera/realsense2_camera/linear_accel_cov: 0.01
/camera/realsense2_camera/odom_frame_id: camera_odom_frame
/camera/realsense2_camera/pointcloud_texture_index: 0
/camera/realsense2_camera/pointcloud_texture_stream: RS2_STREAM_COLOR
/camera/realsense2_camera/pose_frame_id: camera_pose_frame
/camera/realsense2_camera/pose_optical_frame_id: camera_pose_optic...
/camera/realsense2_camera/publish_odom_tf: True
/camera/realsense2_camera/publish_tf: True
/camera/realsense2_camera/rosbag_filename:
/camera/realsense2_camera/serial_no:
/camera/realsense2_camera/tf_publish_rate: 0.0
/camera/realsense2_camera/topic_odom_in: camera/odom_in
/camera/realsense2_camera/unite_imu_method: none
/camera/realsense2_camera/usb_port_id:
/rosdistro: melodic
/rosversion: 1.14.7

NODES
/camera/
realsense2_camera (nodelet/nodelet)
realsense2_camera_manager (nodelet/nodelet)
auto-starting new master
process[master]: started with pid [5804]
ROS_MASTER_URI=http://localhost:11311
setting /run_id to dd9f527e-e2c9-11ea-8b7b-98fa9bae5cf3
process[rosout-1]: started with pid [5815]
started core service [/rosout]
process[camera/realsense2_camera_manager-2]: started with pid [5822]
process[camera/realsense2_camera-3]: started with pid [5823]
[ INFO] [1597916723.024434488]: Initializing nodelet with 8 worker threads.
[ INFO] [1597916723.129487676]: RealSense ROS v2.2.16
[ INFO] [1597916723.129515784]: Built with LibRealSense v2.36.0
[ INFO] [1597916723.129524519]: Running with LibRealSense v2.37.0
[ WARN] [1597916723.129532156]: ***************************************************
[ WARN] [1597916723.129538061]: ** running with a different librealsense version **
[ WARN] [1597916723.129543150]: ** than the one the wrapper was compiled with!   **
[ WARN] [1597916723.129548221]: ***************************************************
[ INFO] [1597916723.137715071]:
[ INFO] [1597916723.501649846]: Device with serial number<PHONE_NUMBER>07 was found.
[ INFO] [1597916723.501708780]: Device with physical ID 2-3-3 was found.
[ INFO] [1597916723.501736056]: Device with name Intel RealSense D455 was found.
[ INFO] [1597916723.502382600]: Device with port number 2-3 was found.
[ INFO] [1597916723.504760215]: getParameters...
[ INFO] [1597916723.548722931]: setupDevice...
[ INFO] [1597916723.548753688]: JSON file is not provided
[ INFO] [1597916723.548766355]: ROS Node Namespace: camera
[ INFO] [1597916723.548779324]: Device Name: Intel RealSense D455
[ INFO] [1597916723.548790888]: Device Serial No:<PHONE_NUMBER>07
[ INFO] [1597916723.548802544]: Device physical port: 2-3-3
[ INFO] [1597916723.548814229]: Device FW version: <IP_ADDRESS>
[ INFO] [1597916723.548824752]: Device Product ID: 0x0B5C
[ INFO] [1597916723.548838200]: Enable PointCloud: Off
[ INFO] [1597916723.548848460]: Align Depth: Off
[ INFO] [1597916723.548860163]: Sync Mode: Off
[ INFO] [1597916723.548904288]: Device Sensors:
[ INFO] [1597916723.597120041]: Stereo Module was found.
[ INFO] [1597916723.647101709]: RGB Camera was found.
[ INFO] [1597916723.647495499]: Motion Module was found.
[ INFO] [1597916723.647557370]: (Fisheye, 0) sensor isn't supported by current device! -- Skipping...
[ INFO] [1597916723.647601234]: num_filters: 0
[ INFO] [1597916723.647637915]: Setting Dynamic reconfig parameters.
[ INFO] [1597916729.054218423]: Done Setting Dynamic reconfig parameters.
[ INFO] [1597916729.056053257]: depth stream is enabled - width: 1280, height: 720, fps: 30, Format: Z16
[ INFO] [1597916729.056768615]: infra1 stream is enabled - width: 1280, height: 800, fps: 30, Format: Y8
[ INFO] [1597916729.057471147]: infra2 stream is enabled - width: 1280, height: 800, fps: 30, Format: Y8
[ INFO] [1597916729.059384603]: color stream is enabled - width: 1280, height: 800, fps: 30, Format: RGB8
[ INFO] [1597916729.059449824]: setupPublishers...
[ INFO] [1597916729.063022139]: Expected frequency for depth = 30.00000
[ INFO] [1597916729.097507320]: Expected frequency for infra1 = 30.00000
[ INFO] [1597916729.120051838]: Expected frequency for infra2 = 30.00000
[ INFO] [1597916729.142710718]: Expected frequency for color = 30.00000
[ INFO] [1597916729.162877638]: setupStreams...
[ INFO] [1597916729.267703179]: insert Depth to Stereo Module
[ INFO] [1597916729.267874007]: insert Color to RGB Camera
[ INFO] [1597916729.268048912]: insert Infrared to Stereo Module
[ INFO] [1597916729.268162352]: insert Infrared to Stereo Module
[ INFO] [1597916729.268305580]: insert Gyro to Motion Module
[ INFO] [1597916729.268480283]: insert Accel to Motion Module
20/08 17:45:29,322 WARNING [140025735567104] (types.cpp:78) hwmon command 0x4f( 0 208 0 0 ) failed (response -21= No data to return)
20/08 17:45:29,323 WARNING [140025735567104] (ds5-motion.cpp:480) IMU Calibration is not available, default intrinsic and extrinsic will be used.
[ INFO] [1597916729.746184403]: SELECTED BASE:Depth, 0
[ INFO] [1597916729.786334569]: RealSense Node Is Up!
20/08 17:45:29,909 WARNING [140025701996288] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: No data available, number: 61
20/08 17:45:29,970 WARNING [140025701996288] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: No data available, number: 61

How should I solve the WARNING [140714708702976] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: No data available, number: 61 error?

Hi @xdwgood   If you only encounter the warning control_transfer returned at the start of launch, or at a rate of about once a minute, then the RealSense ROS wrapper developer has said that it can be safely ignored so long as the topics are being correctly published.
If the warning is being generated in the log continuously however then this can indicate that there is a serious communication problem with the device.
May I first confirm the roslaunch instruction that is being used, please?  The title of the case says rs_launch (suggesting that live camera data is being used) and the first comment in the case says that rs_from_file (data from a recorded bag) is being used.  As the topic /camera/realsense2_camera/rosbag_filename is published, this suggests to me that it is a bag.  Thanks!

@MartyG-RealSense

May I first confirm the roslaunch instruction that is being used, please

yes, I use roslaunch
I checked using rostopic list and all topics were published correctly. So this may not be a problem, but it will mislead newcomers like me.
May I ask, where is a better place to start learning realsense?
@MartyG-RealSense Thanks again for your reply, good team! :heart:

Thanks for your kind words @xdwgood     :)
The official RealSense YouTube channel is a good place to start for a new RealSense user.
https://www.youtube.com/c/IntelRealSense/videos
The official RealSense blog is also excellent at writing about RealSense subjects in a beginner friendy way:
https://www.intelrealsense.com/blog/
Exploring the RealSense Viewer program will expose you naturally to a lot of the camera's operational aspects in a user-friendly format that is easy to experiment with.  The guide document for the Viewer is quite out of date now but is still good for explaining the basics.
https://www.intel.com/content/www/us/en/support/articles/000028593/emerging-technologies/intel-realsense-technology.html
After that, you could move on to the excellent RealSense camera tuning guide.
https://dev.intelrealsense.com/docs/tuning-depth-cameras-for-best-performance
The best way to learn RealSense ROS is to learn about the basics of librealsense first, as having knowledge of the fundamentals of how the camera works is vey useful when understanding what is happening during aspects of ROS such as launching.


cc_library depending on header generated with genrule not regenerating

Reproduction here:
https://github.com/louwers/bug-cc-library-generated-header-rules-xcodeproj
Just run.
git clone git@github.com:louwers/bug-cc-library-generated-header-rules-xcodeproj.git

bazel run //:xcodeproj

bazel build //:lib  # all good

xed Repro.xcodeproj

# run lib target in Xcode

# uncomment first line of gen_header.sh

bazel build //:lib  # now fails due to static_assert(false)

# run lib target in Xcode
# still works, even with static_assert(false); now in the header!

We have the same problem with an ios_application depending on a cc_library like this. But I could not reproduce it with the cc_binary.

I forgot to add the Bazel files to the repro.
They are added now.

Let me know if I should try making a reproduction with the app as well. The full dependency chain is:
genrule <- cc_library (header only) <- cc_library <- objc_library <- objc_library <- ios_application

Is there a way to clear whatever cache is stuck to work around this in the short term? Cleaning the bazel project doesn't appear to be enough.

I was traveling for BazelCon. I can probably look at this tomorrow sometime. But maybe I won't get to it until Friday.

Have fun @brentleyjones :)

And OOO today, I'll look Monday.


GraalVM support

Have you considered adding support for compiling native images using GraalVM?
Rough steps:
    clj -Scp src:$CLASSPATH:$builddir \
      -J-Dclojure.compile.path=$builddir \
      -M -e "(compile (quote ${pname}.core))"

    echo "creating manifest file"
    echo "Main-Class: ${pname}.core" > manifest.txt
    echo "Class-Path: ." >> manifest.txt
    find ${mavenRepository} -name '*.jar' -printf '  %h/%f\n' >> manifest.txt

    echo "creating fat/uber jar"
    jar cvfm ${name}.jar manifest.txt -C $builddir .

    echo "compiling native image"
    native-image \
      -jar ${name}.jar \
      -H:Name=${pname} \
      ... $more_flags

(I suppose the first step is already done today.)

https://github.com/andyscott/rules_graal

Sorry for delay. Yeah as you already figured out it could be achieved with clojure_library -> clojure_java_library -> graal_binary


[metadata] On EC2 hostname/instance id failure, return data from the cache

What does this PR do?
The EC2 local metadata endpoint is sometimes unavailable. When this happen, the agent
will report an empty EC2 hostname and EC2 instance ID and will override the current value that is in Datadog.
Since EC2 hostname / instance id do not change, we can easily reuse what we already cached previously
Motivation
The EC2 local metadata endpoint is sometimes unavailable. When this happen, the agent
will report an empty EC2 hostname and EC2 instance ID and will override the current value that is in Datadog.
Additional Notes
(This PR currently lacks tests)
Describe your test plan
Have thorough tests

We have this: https://github.com/DataDog/datadog-agent/pull/4798 to achieve a similar goal, though covering more edge cases. There's an ongoing discussion to decide what should be done with this - so as to avoid friction with customers and reduce the risk of host churn.

Ah thanks! I didn't see it. Do you know if it's possible to pick it up again ? It looks like recently those cases (and reports) have been more frequent (not sure if that's related to the update of refreshing metadata every 30min instead of 4h or maybe something on AWS side making the endpoint less available)

Reopening: we're tackling a slightly different problem with this, stemming from metadata inconsistency and not canonical hostname resolution (even if the root of the problem is the same - EC2 introspection endpoint flakiness).

As discussed in chat, this uses the in-memory cache, so no concern about using the same state file as in https://github.com/DataDog/datadog-agent/pull/4798 (although as a future improvement, we could definitely use a persistent cache for this, to persist the data across agent restarts).
The PR's caching logic looks good to me, but I think it should be moved down to GetInstance/GetHostname. I'll open a separate PR to address this (hopefully in 7.22).

Superseded by https://github.com/DataDog/datadog-agent/pull/6139, thanks @Viq111 for the initial code proposal!


Setting NUGET_PACKAGES breaks dotnet tools

Type of issue
Code doesn't work
Feedback
There is an issue for this here https://github.com/dotnet/sdk/issues/15306. The documentation should the warn the user about this and hopefully provide a work around. Unfortunately, it does reduce the utility of having a dev drive to a significant extent.
Page URL
https://learn.microsoft.com/en-us/windows/dev-drive/#storing-package-cache-on-dev-drive
Content source URL
https://github.com/MicrosoftDocs/windows-dev-docs/blob/docs/hub/dev-drive/index.md
Author
@mattwojo
Document Id
bfda7965-bc34-ab88-fdc9-efef4a5d8a9e

@mattwojo - please add a known issue regarding the dotnet tools issue referred to above.

Added a note about this known issue for awareness under the Nuget package cache recommendations.
Thanks for raising this issue @kevkov! And for investigating with the .NET team, Adam.
Updated in https://github.com/MicrosoftDocs/windows-dev-docs/commit/ddfe90ad006d62c3a900ca85ccc7df3767b6219f


model edit don't work

this edit fuction in sample_instructions.htm ,button click don't work

after removing the button， how to edit model step angle and other things？

@LasseD

The edit button requires you to implement the functionality of the save-button yourself. Since your initial but report was "button click don't work", I figured the existing documentation was not sufficient, and removed the button from the default sample file.
The button can still be enabled by the method I used to disable it, but the whole functionality requires quite a rewrite of documentation to assist people getting it to work in their own setup. Thus, it has been disabled for the time being.

Thanks for your reply，Looking forward to your updates
sherlock
@.***

------------------ 原始邮件 ------------------
发件人: "Lasse @.>;
发送时间: 2022年12月6日(星期二) 下午2:52
收件人: @.>;
抄送: @.>; @.>;
主题: Re: [LasseD/buildinginstructions.js] model edit don't work (Issue #59)
The edit button requires you to implement the functionality of the save-button yourself. Since your initial but report was "button click don't work", I figured the existing documentation was not sufficient, and removed the button from the default sample file.
The button can still be enabled by the method I used to disable it, but the whole functionality requires quite a rewrite of documentation to assist people getting it to work in their own setup. Thus, it has been disabled for the time being.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: @.***>


EKS not supported on sa-east-1

EKS is now supported on South America (sa-east-1), but rancher does not support it.
I tried manually setting the region, but the provisioning failed saying Rancher does not support the region.

https://docs.aws.amazon.com/pt_br/eks/latest/userguide/eks-optimized-ami.html

Same as https://github.com/rancher/rancher/issues/24400


L9-KEYBOARD crashes after 4 seconds

I have VC-Redist x64 installed, i don't really know why it's crashing

try vcredist 32


(FACT-1888) Return correct facts for os on VZ

Facter 3.12.0 ships d9c30e5 which adds support for VirtuozzoLinux.
This breaks parsing the release information.
Instead, as a fallback, kernel version will be returned.
https://github.com/puppetlabs/facter/pull/1749 adds support
for VZ 6
This commit adds the correct facts for the OS info
on VirtuozzoLinux

root@localhost bin]# ./facter --version
--
3.12.5 (commit c86b1bc6a91ca9614b5d18999d5f5056550ef120)
[root@localhost bin]# ./facter os
{
architecture => "x86_64",
family => "RedHat",
hardware => "x86_64",
name => "VirtuozzoLinux",
release => {
full => "7.6",
major => "7",
minor => "6"
},
selinux => {
enabled => false
}
}
[root@localhost bin]# cat /etc/redhat-release
Virtuozzo Linux release 7.6

CLA signed by all contributors.

jenkins please test this


Title: Dictionary App with Narration

What?
This will be an dictionary app which will fetch the words and the meanings via API and displays it to the user.
Why?
This app could be useful for everyone as we do not have this much time to go for the physical book i.e. dictionary. This could be easy to use tool as well as very interactive with the user.
How?

HTML, CSS and JS is used for the user interaction.
Word meaning API have been used which will fetch all the necessary information about a word.
Narration feature will be there like the word and it's meaning will be narrated to the user.

Demo:

Please assign and consider this issue to me under Hacktoberfest 2022 and add its tags too.

@Atharv-110 looks go to me , move forward and make a pr and dont forget to mention this issue in your pr by adding #your issue no. Here

Pull Request number #5 resolves this issue.


Reading public blob storage folders

This PR adds support for vision_explanation_methods to read public blob storage files. This update is necessary to support DPV2 testing.

Codecov Report

Merging #26 (38f234e) into main (0e4c4f9) will decrease coverage by 0.61%.
The diff coverage is 71.42%.

:exclamation: Current head 38f234e differs from pull request most recent head 386eefb. Consider uploading reports for the commit 386eefb to get more accurate results

@@            Coverage Diff             @@
##             main      #26      +/-   ##
==========================================
- Coverage   88.78%   88.18%   -0.61%
==========================================
  Files           6        6
  Lines         214      220       +6
==========================================
+ Hits          190      194       +4
- Misses         24       26       +2

Flag
Coverage Δ

unittests
88.18% <71.42%> (-0.61%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

python/vision_explanation_methods/DRISE_runner.py
74.24% <71.42%> (-0.76%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Adds write lock strategy per aggregates

Overview
This changes allow to perform a database lock per aggregates in order to avoid concurrency issues in a concurrent environment, such as, multi-threaded env or load balanced event store (multiple event store processes trying to create events on the database at the same time).
The lock only blocks the aggregate, not the entire event table. A RubyEventStore::CannotObtainLock exception is raised in case the lock could not be obtained. Meaning an event store was already trying to perform an INSERT on the given aggregate.
Client's implementation should catch this exception and perform a simple retry in a begin/rescue block:
aggregate_id = SecureRandom.uuid
client = RailsEventStore::Client.new(lock_obtainer: RailsEventStoreActiveRecord::LockObtainer.new)

begin
  event = OrderCreated.new(data: "sample", event_id: SecureRandom.uuid)
  client.publish_event(event, aggregate_id)
rescue RubyEventStore::CannotObtainLock
  retry
end

@gottfrois could you "kill the mutants" ? ;) you need to add additional tests to satisfy mutation testing.
Use make to run mutation tests:
make mutate

@gottfrois need help to kill the mutants?

@mpraglowski sorry haven't looked back at the PR since I wrote it, pretty busy weeks :) I'll see what I can do, maybe next weekend.

make mutate is your friend ;) ping me if you need any help :)

@gottfrois shall I close this PR ? or maybe you want to update it to latest changes?

We can close it. I did not worry about concurrency issue in my project just yet but it's definitely in my todo so I'll revisit the PR when working on that again.


OpenID Connect certification

I checked in https://openid.net/developers/certified/ looking for authlib, I think that it would be a good idea being there in addition.

Duplicate of #220.

Duplicate of #220.

Thank you,
By the way the oidc unit tests can be executed by ourself as self assessment

@peppelinux do you mean https://op.certification.openid.net:60000/ ?

Yes, there should be also the sources of these unit tests in openid GitHub,
for running them completely out of band.
A docker image could be built as well
Il dom 12 lug 2020, 04:46 Hsiaoming Yang<EMAIL_ADDRESS>ha
scritto:

@peppelinux https://github.com/peppelinux do you mean
https://op.certification.openid.net:60000/ ?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/lepture/authlib/issues/250#issuecomment-657165836,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAJ4ZVEUCKNJ4CYKHC3ISFLR3EPZLANCNFSM4OXLJTZQ
.

--
Il banner è generato automaticamente dal servizio di posta elettronica
dell'Università della Calabria
https://www.unical.it/portale/portaltemplates/view/view.cfm?100061

No, I can't find any unit tests in GitHub.

No, I can't find any unit tests in GitHub.

Many repositories moved around, as It was for jwtconnect for identity python. See:
https://github.com/rohe/oidctest
https://github.com/rohe/oictest

As per this page in the official website [1], the conformance suite currently lives at [2].
I'd personally prioritize the open PRs and open issues at the moment, which aren't many, since what's been reported will likely make tests in the conformance suite fail.
[1] https://openid.net/certification/about-conformance-suite/
[2] https://gitlab.com/openid/conformance-suite/


Test case 'id_000000' results in a crash

Hello Ivan,
I use "small.pdf" in testcases and i want to fuzz the program of  SumatraPDF.exe , the flowing command
“D:\learn\winafl\DynamoRIO-Windows-7.0.0-RC1\bin32\drrun.exe -c D:\learn\winafl\DynamoRIO-Windows-7.0.0-RC1\bin32\winafl.dll -debug -target_module  SumatraPDF.exe -target_method  LoadDocIntoCurrentTab -fuzz_iterations 10 -nargs 2 --  D:\learn\winafl\soft\sumatrapdf-master\dbg\SumatraPDF.exe  D:\learn\winafl\soft\sumatrapdf-master\test\input\small.pdf”
works normally with the record of "Everything appears to be running normally."
but the fuzzer does not work at the beginning ,
"D:\learn\winafl\soft\sumatrapdf-master\dbg>D:\learn\winafl\winafl-master\bin32\afl-fuzz.exe -i input -o output  -f small.pdf -D D:\learn\winafl\DynamoRIO-Windows-7.0.0-RC1\bin32 -t 20000 --  -coverage_module SumatraPDF.exe -fuzz_iterations 5000 -target_module SumatraPDF.exe -target_method LoadDocIntoCurrentTab  -nargs 2 -- SumatraPDF.exe @@
WinAFL 1.13 by<EMAIL_ADDRESS>Based on AFL 2.43b by<EMAIL_ADDRESS>[+] You have 4 CPU cores and 0 runnable tasks (utilization: 0%).
[+] Try parallel jobs - see docs\parallel_fuzzing.txt.
[] Checking CPU core loadout...
[+] Found a free CPU core, binding to #0.
[] Setting up output directories...
[+] Output directory exists but deemed OK to reuse.
[] Deleting old session data...
[+] Output dir cleanup successful.
[] Scanning 'input'...
[+] No auto-generated dictionary tokens to reuse.
[] Creating hard links for all input files...
[] Attempting dry run with 'id_000000'...
[-] Oops, the program crashed with one of the test cases provided. There are
several possible explanations:
- The test case causes known crashes under normal working conditions. If
  so, please remove it. The fuzzer should be seeded with interesting
  inputs - but not ones that cause an outright crash.

- Least likely, there is a horrible bug in the fuzzer. If other options
  fail, poke<EMAIL_ADDRESS>for troubleshooting tips.

[-] PROGRAM ABORT : Test case 'id_000000' results in a crash
Location : perform_dry_run(), ..\afl-fuzz.c:2882"
I replace "small.pdf" of other pdf files and receive the same "[-] PROGRAM ABORT : Test case 'id_000000' results in a crash",but if i chang the  "small.pdf" into  "small.txt" .Fancy it works!
So what is going on ,please give me some directions.
Thanks.

D:\winafl\build\bin\Release>afl-fuzz.exe -i testcases -o out -t 20000 -D D:\dynamorio\DynamoRIO-Windows-6.2.0-2\bin32 -- -coverage_module 7za.exe -target_module 7za.exe -target_method main -nargs 3 -- 7za.exe x @@
WinAFL 1.16b by<EMAIL_ADDRESS>Based on AFL 2.43b by<EMAIL_ADDRESS>[+] You have 12 CPU cores and 0 runnable tasks (utilization: 0%).
[+] Try parallel jobs - see docs\parallel_fuzzing.txt.
[*] Checking CPU core loadout...
[+] Found a free CPU core, binding to #0.
[+] Process affinity is set to 1.
[] Setting up output directories...
[+] Output directory exists but deemed OK to reuse.
[] Deleting old session data...
[+] Output dir cleanup successful.
[] Scanning 'testcases'...
[+] No auto-generated dictionary tokens to reuse.
[] Creating hard links for all input files...
[*] Attempting dry run with 'id_000000'...
[-] The program took more than 20000 ms to process one of the initial test cases.
Usually, the right thing to do is to relax the -t option - or to delete it
altogether and allow the fuzzer to auto-calibrate. That said, if you know
what you are doing and want to simply skip the unruly test cases, append
'+' at the end of the value passed to -t ('-t 20000+').
[-] PROGRAM ABORT : Test case 'id_000000' results in a timeout
Location : perform_dry_run(), d:\winafl\afl-fuzz.c:2972
0 processes nudged


Select root node on graph focus

After you click on graph, the root node should get selected.

Fixed with #18255


NoMethodError: undefined method `MailChimpError' for Gibbon:Module

View details in Rollbar: https://rollbar.com/trystant/BOW/items/221/

Faraday::ResourceNotFound: the server responded with status 404
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/faraday-0.9.1/lib/faraday/response/raise_error.rb", line 8, in on_complete
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/faraday-0.9.1/lib/faraday/response.rb", line 9, in block in call
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/faraday-0.9.1/lib/faraday/response.rb", line 57, in on_complete
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/faraday-0.9.1/lib/faraday/response.rb", line 8, in call
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/faraday-0.9.1/lib/faraday/rack_builder.rb", line 139, in build_response
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/faraday-0.9.1/lib/faraday/connection.rb", line 377, in run_request
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/faraday-0.9.1/lib/faraday/connection.rb", line 140, in get
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/gibbon-2.0.0/lib/gibbon/api_request.rb", line 37, in get
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/gibbon-2.0.0/lib/gibbon/request.rb", line 40, in retrieve
  File "/Users/dariusgoore/development/blackops/app/models/user.rb", line 37, in mailchimp_user
  File "/Users/dariusgoore/development/blackops/app/models/user.rb", line 71, in add_to_mailchimp
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activesupport-4.2.3/lib/active_support/callbacks.rb", line 430, in block in make_lambda
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activesupport-4.2.3/lib/active_support/callbacks.rb", line 237, in call
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activesupport-4.2.3/lib/active_support/callbacks.rb", line 237, in block in halting
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activesupport-4.2.3/lib/active_support/callbacks.rb", line 504, in call
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activesupport-4.2.3/lib/active_support/callbacks.rb", line 504, in block in call
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activesupport-4.2.3/lib/active_support/callbacks.rb", line 504, in each
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activesupport-4.2.3/lib/active_support/callbacks.rb", line 504, in call
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activesupport-4.2.3/lib/active_support/callbacks.rb", line 88, in run_callbacks
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activemodel-4.2.3/lib/active_model/validations/callbacks.rb", line 113, in run_validations!
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activemodel-4.2.3/lib/active_model/validations.rb", line 334, in valid?
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/validations.rb", line 58, in valid?
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/validations.rb", line 83, in perform_validations
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/validations.rb", line 37, in save
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/attribute_methods/dirty.rb", line 21, in save
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/transactions.rb", line 286, in block (2 levels) in save
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/transactions.rb", line 351, in block in with_transaction_returning_status
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/connection_adapters/abstract/database_statements.rb", line 213, in block in transaction
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/connection_adapters/abstract/transaction.rb", line 184, in within_new_transaction
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/connection_adapters/abstract/database_statements.rb", line 213, in transaction
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/transactions.rb", line 220, in transaction
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/transactions.rb", line 348, in with_transaction_returning_status
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/transactions.rb", line 286, in block in save
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/transactions.rb", line 301, in rollback_active_record_state!
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activerecord-4.2.3/lib/active_record/transactions.rb", line 285, in save
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/devise-3.4.1/app/controllers/devise/registrations_controller.rb", line 19, in create
  File "/Users/dariusgoore/development/blackops/app/controllers/users/registrations_controller.rb", line 13, in create
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/actionpack-4.2.3/lib/action_controller/metal/implicit_render.rb", line 4, in send_action
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/actionpack-4.2.3/lib/abstract_controller/base.rb", line 198, in process_action
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/actionpack-4.2.3/lib/action_controller/metal/rendering.rb", line 10, in process_action
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/actionpack-4.2.3/lib/abstract_controller/callbacks.rb", line 20, in block in process_action
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activesupport-4.2.3/lib/active_support/callbacks.rb", line 115, in call
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activesupport-4.2.3/lib/active_support/callbacks.rb", line 115, in call
  File "/Users/dariusgoore/development/blackops/.bundle/gems/ruby/2.2.0/gems/activesupport-4.2.3/lib/active_support/callbacks.rb", line 553, in block (2 levels) in compile
  F

Are these duplicates, or are these being closed because they're "hanging around too long"?

It seems like it's because these are duplicates @campgurus, but can you confirm?


Missing index.yml

With the latest update of toucan, I succeeded in installing it using sudo. This should be mentioned in the installation guide, otherwise there will be a permission error.
Now, I followed the basic setup. However, there is no site generated, the messages issued by toucan watch are:
2024-10-16T11:17:26+0200 info toucan : [toucan_cli] 👀 Watching: `./src` -> ./docs.
2024-10-16T11:17:26+0200 error toucan : [toucan_cli] missing(src/contents/index.yml -- file:///xxx/toucan/cse-home/src/)

I have no clue how that index.yml should look like - can you help, please?

Hardy

FYI: https://toucansites.com/last-alpha-release/


tensorflow 2.0.0 build error

Hi,
Thanks for sharing your work!
I followed your instruction and tried to install tensorflow 2.0.0 on my jetson nano, however it gave below error after a long time compilation.
tensorflow/python/lib/core/bfloat16.cc:608:60: note:   no known conversion for argument 2 from '<unresolved overloaded function type>' to 'PyUFuncGenericFunction {aka void (*)(char**, const long int*, const long int*, void*)}'
Target //tensorflow/tools/pip_package:build_pip_package failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 52964.953s, Critical Path: 1102.32s
INFO: 5632 processes: 5632 local.
FAILED: Build did NOT complete successfully

my system setup is:
jetpack 4.3
tensorrt 6.0.1
cuda 10.0.326
python 3.7
Could you please suggest how can fix this issue?

I have seen a similar issue when building tensorflow-2.3.0 on Jetson Xavier NX.  That's why I created the tensorflow-2.3.0.patch with fixes for the "PyUFuncGenericFunction" issue.

Thanks for your reply. I assume this patch cannot fix tensorflow 2.0.0 issue that i mentioned above. Otherwise can I install tf 2.3.0 version in jetpack 4.3 using your script?

The patch is for 2.3.0.  But you should be able to find the same lines of code in tensorflow-2.0.0 source and manually patch the code.
I have not tried to run "install_tensorflow-2.3.0.sh" on JetPack-4.3.  It might not work out of the box...

Hi,
I burned another SD card with JetPack 4.4, and installed tensorflow-2.3.0 successfully, although it took 3 days to complete on Nano. When it was installing scipy==1.4.1 as part of tensorflow wheel, it gave an error"numpy.disutils.system_info.NotFounfError: No lapacl/blas resources found". I fixed this issue based on this discussion. solution is:
sudo apt-get install gfortran libopenblas-dev liblapack-dev sudo pip install scipy==1.2.1
Hope this will be helpful to who may this issue in the future.
@jkjung-avt , thanks again for your work, I will close this issue for now.


Error in Compilation

Hi,
As one more person mentioned in another issue of the code, I am having the same error. I am using Arduino IDE to compile for Intel Galileo
Interrupt.ino: In function 'void interruptSetup()':
Interrupt.ino:17:3: error: 'TCCR2A' was not declared in this scope
Interrupt.ino:18:3: error: 'TCCR2B' was not declared in this scope
Interrupt.ino:19:3: error: 'OCR2A' was not declared in this scope
Interrupt.ino:20:3: error: 'TIMSK2' was not declared in this scope
Interrupt.ino:21:7: error: 'sei' was not declared in this scope
Interrupt.ino: At global scope:
Interrupt.ino:27:4: error: expected constructor, destructor, or type conversion before '(' token
Error compiling.
Anyone has any idea why we are getting this error?

Same Issue. Any help on this?

Yeah I found that since arduino is Atmel based and Galileo is Quark based so they are not fully compatible. That's why we are getting interrupts error. I found out that for pulse sensor they have c++ code in Intel upm library http://iotdk.intel.com/docs/master/upm/dir_3d88723ba241360d69dd8d7099a56335.html but it not selectable in eclipse sensor view so I created an issue in upm GitHub page  https://github.com/intel-iot-devkit/upm/issues/300 but apparently the pulse sensor developer are busy in some more important issues then fixing bugs. There is also support for this sensor in Intel IOT eclipse for Java but for that first we will need to install Java in the Linux image which Intel provides, since it do not come pre installed with it ironically. So I am trying to install Java in the linux image at the moment.
I am trying to install Java because I have some other requirements but if you want to use arduino IDE, I found one http://gowrisomanath.github.io/gsPulseHeartRate/. Also they have C++ library too but I haven't tried it yet

Hi, I've the same problem, but with an ArduinoUno (last version) board.
sketch_jan09c.ino: In function 'void setup()':
sketch_jan09c.ino:37:18: error: 'interruptSetup' was not declared in this scope
sketch_jan09c.ino: In function 'void loop()':
sketch_jan09c.ino:47:18: error: 'serialOutput' was not declared in this scope
sketch_jan09c.ino:55:37: error: 'serialOutputWhenBeatHappens' was not declared in this scope
I'm an old Max users, but very new in Arduino.


Modulesync 4.1.0 forever

This is another attempt to fix the module CI :-)  We already have two tries which are currently broken (#290, #292), and I did not want to mess two much with them because I am not sure to reach something that works better :unamused:…
So far, it is based on on the following PRs:

#291
#290 (rebased on top of the previous changes)

On top of which some more commits are put.

@ekohl thanks for the review!  I fixed the issues you spotted.
There are a few more possible enhancements (e.g. updating the versions of supported OS) but I think it's better to do it in another PR for the purpose of a readable ChangeLog.  Other non-function changes are however still welcome if you see more!


That's 100 lines that end in a tokenized period ('.')

what is the importance of these three warnings that I get them every time I calculate bleu score?

        sacrelogger.warning("That's 100 lines that end in a tokenized period ('.')")
        sacrelogger.warning("It looks like you forgot to detokenize your test data, which may hurt your score.")
        sacrelogger.warning("If you insist your data is detokenized, or don't care, you can suppress this message with the `force` parameter.")

It is exactly as written in the warning (it is a single warning message on three lines). SacreBLEU expects detokenized input (both the hypothesis to be scored and the reference should be detokenized). SacreBLEU does tokenization internally, to make sure it is exactly the same tokenization for everyone (well, there are multiple tokenizations to choose from with --tok, but this choice is encoded in the SacreBLEU signature).
When a line ends with a space and period, there is a high probability the string was tokenized, i.e. it is not the final form which should be presented to users. When there are more than 100 such lines, the probability is much higher, so a warning is reported.

Thanks for your reply! both hypothesis and the reference are already detokenized, hypothesis are generated by T5 model.

@martinpopel Thanks for your reply! yes, it is clear I have them detokenized already to be as input to measure bleu score, and yes I have most of them ends with space then a period in both hypothesis and reference.  Ok another question please, is there any relation between bleu score and model loss?

Yes, there is a relation. BLEU usually correlates with the test loss (the higher BLEU, the lower loss) to some extent, esp. if computed on the same test set. This question is not related to the original issue (nor SacreBLEU), so I am closing it.


feat(context): Support unix context and daemonless

Fix #1056
This PR adds two new image tensorchord/envd-from-scratch built by goreleaser, and tensorchord/envd built by the build.sh.
Users can use tensorchord:envd to run build daemonlessly:
docker run \
    -it \
    --rm \
    --security-opt seccomp=unconfined \
    --security-opt apparmor=unconfined \
    -e BUILDKITD_FLAGS=--oci-worker-no-process-sandbox \
    --entrypoint /envd-daemonless.sh \
    -v /home/gaocegege/code/go/src/github.com/tensorchord/envd/examples/python-basic:/tmp/work t
ensorchord/envd:daemonless-rootless --debug build -p /tmp/work --output type=image,name=test

LGTM. What's the advantage of daemonless?

As @Xiaoaier-Z-L said, there is no need to launch a buildkitd deployment on Kubernetes. We can just create a job to build envd image.

Comments addressed, PTAL.


ModuleNotFoundError: No module named 'win32process'

Hi there,
I ran into a strange issue and was hoping someone could shed some light on it.
I was seeing if the packaged installed which it looks like it did, but immediately ran into a problem.  Here is my code:
from pywinauto.application import Application
#import os
#import timer

app = Application().start("notepad.exe")

I get this traceback
> Traceback (most recent call last):
  File "D:/Onedrive/Documents/Programming Projects/Python/hashcatAutoSaveV2.py", line 1, in <module>
    from pywinauto.application import Application
  File "C:\Users\mmoli\AppData\Local\Programs\Python\Python36-32\lib\site-packages\pywinauto\__init__.py", line 40, in <module>
    from . import findwindows
  File "C:\Users\mmoli\AppData\Local\Programs\Python\Python36-32\lib\site-packages\pywinauto\findwindows.py", line 42, in <module>
    from . import controls
  File "C:\Users\mmoli\AppData\Local\Programs\Python\Python36-32\lib\site-packages\pywinauto\controls\__init__.py", line 36, in <module>
    from . import uiawrapper # register "uia" back-end (at the end of uiawrapper module)
  File "C:\Users\mmoli\AppData\Local\Programs\Python\Python36-32\lib\site-packages\pywinauto\controls\uiawrapper.py", line 40, in <module>
    from .. import backend
  File "C:\Users\mmoli\AppData\Local\Programs\Python\Python36-32\lib\site-packages\pywinauto\backend.py", line 35, in <module>
    from .base_wrapper import BaseWrapper
  File "C:\Users\mmoli\AppData\Local\Programs\Python\Python36-32\lib\site-packages\pywinauto\base_wrapper.py", line 41, in <module>
    import win32process
ModuleNotFoundError: No module named 'win32process'

I read on this thread that it is an issue with pypiwin32 and ran the command he recommended which gave me this:
> D:\Onedrive\desktop\ITTools\hashcat-0.60>py -m pip install -U pypiwin32
Requirement already up-to-date: pypiwin32 in c:\users\mmoli\appdata\local\programs\python\python36-32\lib\site-packages

Unfortunately, it did not fix the issue.  Any help would be very appreciated.

I had the same problem. pip install -U pypiwin32 did not fix the issue for me as well
but he also mentioned that you can manually install it
with that link https://sourceforge.net/projects/pywin32/files/pywin32/
I installed Build 221 and now it works fine

Thanks for the suggestion

This suggestion didn't work for me on Mac OSX, still getting this error:
import win32process
E   ModuleNotFoundError: No module named 'win32process'

Official PyPI package name is pywin32, not pypiwin32 (outdated name and version which should be deleted first). Of course, this is for Windows OS only. Current pywinauto release works on Windows and have very small functions on Linux. So macOS is not supported yet.
macOS support is ongoing. See this pull request for example: https://github.com/pywinauto/pywinauto/pull/841 It will be next major release with full support for both Linux and macOS. Can't provide exact ETA for 0.7.0, it could be this year or next one.


Logs or Button Config

I was installing titles from CDN and one failed (possibly because titles larger than 2GB fail) so I picked up my console to read the title ID to see what it was and I hit the right bumper when picking it up so the dialog closed and it moved on to the next ticket.  Is it possible to re-assign button mapping so I don't hit bumpers by accident when picking up my console?  What about a log file for what FBI does so I can read it in the event it freezes, crashes or I make a mistake like hitting the button?

Just don't hit the button. Not really enough of an issue to warrant these changes.


support text node distribution to default slot

Fixes #4109

Closing per https://github.com/Polymer/polymer/issues/4109#issuecomment-257019369, since there's no way to make native Shadow DOM match this behavior.


After converting to TFLite the network lost structure and return zero

System information

OS Platform and Distribution  - Linux Ubuntu 20.04 LTS, 64bit:
TensorFlow installed from conda:
TensorFlow version 2.2.0:
Python version 3.8.5:
GCC/Compiler version 9.3.0:
CUDA/cuDNN version 11.0:
GPU model and memory GTX 1080, 12GB:

Problem
I did a model training for my own data set. I used the model from the Tensorflow V2 Zoo repository: ssd_resnet50_v1_fpn_1024x1024_coco17_tpu-8.
python model_main_tf2.py --model_dir=trening_demo/models/my_ssd_resnet50_v1_fpn_1024x1024_coco17_tpu-8 \
			 --pipeline_config_path=trening_demo/pre-trained-models/ssd_resnet50_v1_fpn_1024x1024_coco17_tpu-8/pipeline.config

I did training the model for the dataset and I exported the model using this command:
python export_tflite_graph_tf2.py --pipeline_config_path trening_demo/pre-trained-models/ssd_resnet50_v1_fpn_1024x1024_coco17_tpu-8/pipeline.config --trained_checkpoint_dir trening_demo/models/my_ssd_resnet50_v1_fpn_1024x1024_coco17_tpu-8/ --output_directory trening_demo/exported-models-tflite/ex_my_ssd_resnet50_v1_fpn_1024x1024_coco17_tpu-8

Then I run the detector for the saved model and the results are satisfactory.  Then I wanted to convert the saved model to TFLite.
I use:
import tensorflow as tf

# Convert the model
converter = tf.lite.TFLiteConverter.from_saved_model(saved_model_dir) # path to the SavedModel directory
converter.optimizations = [lite.Optimize.DEFAULT]
tflite_model = converter.convert().

# Save the model.
with open('model.tflite', 'wb') as f:
  f.write(tflite_model)

Then I run the detector for tflite_model and the results are zeros. This line of code return zero:
# Retrieve detection results
boxes = interpreter.get_tensor(output_details[0]['index'])[0] # Bounding box coordinates of detected objects
classes = interpreter.get_tensor(output_details[1]['index'])[0] # Class index of detected objects
scores = interpreter.get_tensor(output_details[2]['index'])[0] # Confidence of detected objects
#num = interpreter.get_tensor(output_details[3]['index'])[0]  # Total number of detected objects (inaccurate and not needed)

Error:
---------------------------------------------------------------------------
IndexError                                Traceback (most recent call last)
<ipython-input-20-ca031052c9d2> in <module>()
     23     print(interpreter.get_tensor(output_details[3]['index']))
     24     # Retrieve detection results
---> 25     boxes = interpreter.get_tensor(output_details[0]['index'])[0] # Bounding box coordinates of detected objects
     26     classes = interpreter.get_tensor(output_details[1]['index'])[0] # Class index of detected objects
     27     scores = interpreter.get_tensor(output_details[2]['index'])[0] # Confidence of detected objects

IndexError: invalid index to scalar variable.

So, I compared the network structures with the Netron program. The structure of pre-trained model form tf model Zoo:

The structure of the network after training:

The structuer after convert to TFLite

Why has the network been so reduced? How to solve problems?
Best,

@jvishnuvardhan  Thank you for your response!!!. Link to the model and the tflite file:
https://drive.google.com/drive/folders/1Hz4BdMw2xg5t1rRMhl0smiz17GnL-Pz5?usp=sharing
https://drive.google.com/file/d/1_Rg3PcHTZ5w561QiSaINQZ-GzknAym3b/view?usp=sharing
This is the code that I use for convert model to TFLite
import tensorflow as tf
import importlib.util
converter = tf.lite.TFLiteConverter.from_saved_model('/content/model_temp/exported-models-tflite/ex_my_ssd_resnet50_v1_fpn_1024x1024_coco17_tpu-8/saved_model')
tflite_model = converter.convert()
with open('/content/model_temp/c-tflite/model.tflite', 'wb') as f:
  f.write(tflite_model)

len(tflite_model)

To run detector I use standard code:
PATH_TO_LABELS = '/content/model_temp/labelmap-and-images/labelmap/labelmap.txt'
with open(PATH_TO_LABELS, 'r') as f:
    labels = [line.strip() for line in f.readlines()]

PATH_TO_CKPT = '/content/model_temp/c-tflite/model.tflite'

#pkg = importlib.util.find_spec('tflite_runtime')
#f pkg:
#    from tflite_runtime.interpreter import Interpreter
#else:
from tensorflow.lite.python.interpreter import Interpreter

interpreter = Interpreter(model_path = PATH_TO_CKPT)

print(interpreter)
interpreter.allocate_tensors()

# Get model details
input_details = interpreter.get_input_details()
output_details = interpreter.get_output_details()
height = input_details[0]['shape'][1]
width = input_details[0]['shape'][2]

print(height)
print(width)

floating_model = (input_details[0]['dtype'] == np.float32)

input_mean = 127.5
input_std = 127.5

# Loop over every image and perform detection
for image_path in IMAGE_PATHS:

    # Load image and resize to expected shape [1xHxWx3]
    image = cv2.imread(image_path)
    image_rgb = cv2.cvtColor(image, cv2.COLOR_BGR2RGB)
    imH, imW, _ = image.shape
    image_resized = cv2.resize(image_rgb, (width, height))
    input_data = np.expand_dims(image_resized, axis=0)

    # Normalize pixel values if using a floating model (i.e. if model is non-quantized)
    if floating_model:
        input_data = (np.float32(input_data) - input_mean) / input_std

    # Perform the actual detection by running the model with the image as input
    print(input_data.dtype)
    interpreter.set_tensor(input_details[0]['index'],input_data)
    interpreter.invoke()

    print(interpreter.get_tensor(output_details[0]['index']))
    print(interpreter.get_tensor(output_details[1]['index']))
    print(interpreter.get_tensor(output_details[2]['index']))
    print(interpreter.get_tensor(output_details[3]['index']))
    # Retrieve detection results
    boxes = interpreter.get_tensor(output_details[0]['index'])[0] # Bounding box coordinates of detected objects
    classes = interpreter.get_tensor(output_details[1]['index'])[0] # Class index of detected objects
    scores = interpreter.get_tensor(output_details[2]['index'])[0] # Confidence of detected objects
    #num = interpreter.get_tensor(output_details[3]['index'])[0]  # Total number of detected objects (inaccurate and not needed)

    # Loop over all detections and draw detection box if confidence is above minimum threshold
    for i in range(len(scores)):
        if ((scores[i] > min_conf_threshold) and (scores[i] <= 1.0)):

            # Get bounding box coordinates and draw box
            # Interpreter can return coordinates that are outside of image dimensions, need to force them to be within image using max() and min()
            ymin = int(max(1,(boxes[i][0] * imH)))
            xmin = int(max(1,(boxes[i][1] * imW)))
            ymax = int(min(imH,(boxes[i][2] * imH)))
            xmax = int(min(imW,(boxes[i][3] * imW)))

            cv2.rectangle(image, (xmin,ymin), (xmax,ymax), (10, 255, 0), 2)

            # Draw label
            object_name = labels[int(classes[i])] # Look up object name from "labels" array using class index
            label = '%s: %d%%' % (object_name, int(scores[i]*100)) # Example: 'person: 72%'
            labelSize, baseLine = cv2.getTextSize(label, cv2.FONT_HERSHEY_SIMPLEX, 0.7, 2) # Get font size
            label_ymin = max(ymin, labelSize[1] + 10) # Make sure not to draw label too close to top of window
            cv2.rectangle(image, (xmin, label_ymin-labelSize[1]-10), (xmin+labelSize[0], label_ymin+baseLine-10), (255, 255, 255), cv2.FILLED) # Draw white box to put label text in
            cv2.putText(image, label, (xmin, label_ymin-7), cv2.FONT_HERSHEY_SIMPLEX, 0.7, (0, 0, 0), 2) # Draw label text

@Rariusz You need to follow the instructions here to convert TF2 detection models for TFLite. There is an intermediate step where you export TFLite-specific SavedModel for TFLite converter.

@Rariusz You need to follow the instructions here to convert TF2 detection models for TFLite. There is an intermediate step where you export TFLite-specific SavedModel for TFLite converter.

Dear @srjoglekar246 Thank you for your help. I prepared 200 photos for the conversion of the model. Code:
import tensorflow as tf
import importlib.util
import multiprocessing

def representative_data_gen():
  dataset_list = tf.data.Dataset.list_files ('/content/model_temp/ed/*')
  for i in range(100):
    image = next(iter(dataset_list))
    image = tf.io.read_file(image)
    image = tf.io.decode_jpeg(image, channels=3)
    image = tf.image.resize(image, [1024, 1024])
    image = tf.cast(image / 255., tf.float32)
    image = tf.expand_dims(image, 0)
    yield [image]

In the above function I am using decode_jpeg however, my photos have the extension *** .jpg.** I assume it doesn't matter
converter = tf.lite.TFLiteConverter.from_saved_model('/content/model_temp/exported-models-tflite/ex_my_ssd_resnet50_v1_fpn_1024x1024_coco17_tpu-8/saved_model')
converter.optimizations = [tf.lite.Optimize.DEFAULT]
converter.target_spec.supported_ops = [tf.lite.OpsSet.TFLITE_BUILTINS_INT8]
converter.inference_input_type = tf.uint8
converter.inference_output_type = tf.uint8
converter.representative_dataset = representative_data_gen

tflite_model = converter.convert()
with open('/content/model_temp/c-tflite/model.tflite', 'wb') as f:
  f.write(tflite_model)

len(tflite_model)

After starting the program, I have the following error:
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
/usr/local/lib/python3.6/dist-packages/tensorflow/lite/python/optimize/calibrator.py in __init__(self, model_content)
     51       self._calibrator = (
---> 52           _calibration_wrapper.CalibrationWrapper(model_content))
     53     except Exception as e:

TypeError: pybind11::init(): factory function returned nullptr

During handling of the above exception, another exception occurred:

ValueError                                Traceback (most recent call last)
4 frames
/usr/local/lib/python3.6/dist-packages/tensorflow/lite/python/optimize/calibrator.py in __init__(self, model_content)
     52           _calibration_wrapper.CalibrationWrapper(model_content))
     53     except Exception as e:
---> 54       raise ValueError("Failed to parse the model: %s." % e)
     55     if not self._calibrator:
     56       raise ValueError("Failed to parse the model.")

ValueError: Failed to parse the model: pybind11::init(): factory function returned nullptr.

I read that this may be a problem with the TensorRT version. Right? I use google colab.

@Rariusz replying to your thread here. Can you check if you are able to convert the floating-point model fine? There might be a bug in the quantization code, so its better to do a sanity check first.


Cube print respin

Now with no specific reference to ugrid.
This is now an extensive refactor of the Iris Cube summary and _repr_html_ methods.
Including changes needed to enable the forthcoming iris-ugrid UCubes to produce "extended" cube summmaries.
I have added testing for the new factored-out helper methods.  But I haven't provided any test of how modifying these can produce extended cube summaries, as its not really an "API" + the requirement is hard to generalise.
That usage will eventually get tested by the specifics in iris-ugrid.
Meanwhile, you should see that all the existing tests simply pass. :bow_and_arrow:
Proposals for the specific use of this in iris-ugrid are here : https://github.com/SciTools-incubator/iris-ugrid/pull/26

Hi @trexfeathers
Hoping you can do this ?  It's a bit of a big lump to swallow in one, but I've tried to make the individual commit changes intelligible.

Hi @trexfeathers
Hoping you can do this ?

@pp-mo I'm on it now 👀 sorry for the delay.

Note to self: have so far reviewed up to and including: 988710ca9a50cb161bf40b5ac99931c42ee6632b

Many thanks @trexfeathers .  You seem to have done a very thorough job here ! :rocket:
Hoping the latest addresses your comments.

@trexfeathers
Just to note, some of the points you raised I was originally side-stepping, because I was rather focussed on "pure refactoring".
I.E. I was sticking to "no functional change, even to fix things" , so as not to possibly break backwards-compatibility.
But in retrospect, that may be a useful reference idea, but it is over-strict :
We don't really expect anyone's code to be undermined by a slightly different cube-summary output, especially if it is "better".
We can take the opportunity to improve some things, just as we do to add some missing testing.

Since @trexfeathers prompting above, I have realised that none of the element sorting is actually needed, as all the relevant cube access methods provide results already sorted, by (cube-dims, name), which is exactly what we wanted.
E.G. cube.aux_coords.
So, I have now removed all that sorting code.
Also I have now rationalised all the scalar-element testing : "Scalar" elements are now consistently those with an empty ".cube_dims(cube)"  -- any testing for a shape of (1,) I think was legacy which is now doing simply nothing.
ALSO, I've added a possible "scalar ancillary variables" section, which was previously missing.

So long as the tests pass, I will be happy with this..!


⚠ Processors has degraded performance

In 5b1b5a2, Processors ($STATUS_URL) experienced degraded performance:

HTTP code: 200
Response time: 46 ms

Resolved: Processors performance has improved in 364570f.


Add indent option to nvim-orgmode

This PR adds the org_startup_indented option to nvim-orgmode.

This is unnecessary because settings is a freeform option. This means users can configure anything, even if we don't declare a corresponding sub-option.
This will add the sub-option to our docs, and will enforce type-checking (i.e. checking it is a boolean), but these are both double-edged swords because it is more surface area for us to keep in sync with any changes in the upstream plugin.

it is more surface area for us to keep in sync with any changes in the upstream plugin.

I understand. Then I will close this PR.
But I have another question please: maybe I should then open a PR that rempove this https://github.com/nix-community/nixvim/blob/18b7597e6ca4b98a6c3f20ddc9783165d5998018/plugins/languages/nvim-orgmode.nix#L17 and this https://github.com/nix-community/nixvim/blob/18b7597e6ca4b98a6c3f20ddc9783165d5998018/plugins/languages/nvim-orgmode.nix#L20?

There's no hard and fast rules currently for whether or not we should have any particular settings-options.
You're more than welcome to re-open this PR if you think it's useful to have the sub-option declared in nixvim. Alternatively, we could add it to the settingsExample without declaring an option.
As for the options you've already added, I think they're fine. There's plenty of other plugins that have far more settings-options declared than this one.
I don't mind if/how you want to continue with this PR, I just wanted to ensure you were aware that settings was freeform before proceeding 😁

Alternatively, we could add it to the settingsExample without declaring an option.

I prefer to remove the 2 options but leave them in the settingsExample.

I don't mind if/how you want to continue with this PR

I would prefer to leave it closed if thats ok by you.

I just wanted to ensure you were aware that settings was freeform before proceeding 😁

Now that I am aware, I wanna remove the 2 options I added. If thats ok by you, I will open a PR that removes them.


Footnote patches in 4.20.xx

@geek1011
I don't think your official nickel patch Change pop-up footnote font-family is doing anything anymore. If the aim is to make sure pop-up footnotes use Georgia (rather than Avenir) then I think the patch can be removed. However, if the aim is to give font-family full customisation to the user then I think a new pop-up footnote code investigation is needed. Second opinions welcome 😄
As a follow on ... I've previously posted an unofficial patch to control font-size of footnote text. This no longer works either. As with many parts of the GUI (IMO) default footnote font-size on a KA1/Forma is huge. Other models seem OK.
test Pop-up footnote main text font-size:
  - Enabled: no
  - Description: Change font-size of pop-up footnote main text.
  - FindZlib: "RegularTouchLabel {\n  font-family"
  - ReplaceZlibGroup:
      Replacements:
        # RegularTouchLabel Popup footnote main text
        # Change Replace font-size as required for your Kobo model
          #Touch/Mini
        - Find:    "RegularTouchLabel[qApp_deviceIsTrilogy=true] {\n  font-size: 19px;\n}"
          Replace: "RegularTouchLabel[qApp_deviceIsTrilogy=true] {\n  font-size: 19px;\n}"
          #Glo/Aura/Aura2
        - Find:    "RegularTouchLabel[qApp_deviceIsPhoenix=true] {\n  font-size: 23px;\n}"
          Replace: "RegularTouchLabel[qApp_deviceIsPhoenix=true] {\n  font-size: 23px;\n}"
          #AuraHD/H2O/H2O2
        - Find:    "RegularTouchLabel[qApp_deviceIsDragon=true] {\n  font-size: 29px;\n}"
          Replace: "RegularTouchLabel[qApp_deviceIsDragon=true] {\n  font-size: 29px;\n}"
          #GloHD
        - Find:    "RegularTouchLabel[qApp_deviceIsAlyssum=true] {\n  font-size: 32px;\n}"
          Replace: "RegularTouchLabel[qApp_deviceIsAlyssum=true] {\n  font-size: 32px;\n}"
          #ClaraHD
        - Find:    "RegularTouchLabel[qApp_deviceIsNova=true] {\n  font-size: 32px;\n}"
          Replace: "RegularTouchLabel[qApp_deviceIsNova=true] {\n  font-size: 32px;\n}"
          #LibraH2O
        - Find:    "RegularTouchLabel[qApp_deviceIsStorm=true] {\n  font-size: 34px;\n}"
          Replace: "RegularTouchLabel[qApp_deviceIsStorm=true] {\n  font-size: 34px;\n}"
          #AuraOne/Forma
        - Find:    "RegularTouchLabel[qApp_deviceIsDaylight=true] {\n  font-size: 37px;\n}"
          Replace: "RegularTouchLabel[qApp_deviceIsDaylight=true] {\n  font-size: 34px;\n}"

The only workaround I've found so far is a new libnickel patch, but it's not ideal because it doesn't allow a different font-size per model.
test Pop-up footnote main text font-size:
  - Enabled: no
  - Description: |
        Change pop-up footnote main text font-size
        fw 4.20.14601 CSS moved to libnickel.so.1.0.0 from nickel???
        Daylight: %1 = 42 ???
  - FindReplaceString:
      Find:    "p { font-size: %1px; line-height: 1.4em; }"
      Replace: "p { font-size: 34px; line-height: 1.4em; }"
      MustMatchLength: yes

If we knew where the %1px value was being read from it might be a help.

I'm most likely going to remove it, then (I'm didn't originally create that one, I don't use it, and I'm not familiar enough with it).

Hmm, as I remember, you created the footnote font-family patch when I asked you whether it could be done. You were the one who told me that it was "hidden" in the CSS stream containing #ConfirmationDialog. I'm not convinced this stream is still the right one. Hence my original question.

I'd have to look at my notes. I honestly don't remember doing it, but what you said rings a bell for me. Sorry about my forgetfulness.

OK, I guess I was thinking of a different footnote patch earlier which wasn't mine.
I just had a look at this, and it does seem to have changed. Your new patch is correct, as confirmed by:

My patch wasn't intended to do anything other than change the font-family, so it doesn't seem like it is necessary anymore (the font is now serif by default).
I'm going to remove this patch, but if anyone ends up wanting to change the font-size, I'll include the one you posted above.

I missed your response until just now. Thanks for looking.
My Assembler is non-existent but your code snippet DictionaryView::fontSize() const seems to suggest that footnote pop-up font-size is using the same value as dictionary pop-up font-size. This matches my observations on KA1/Forma which both default to 42px.
I've still no idea where these font-size constants are being set, though. Does that snippet provide any clues to you? I investigated by quick&dirty patching a few occurrences of Daylight/font-size:42px in the nickel CSS but none of them did me any good.


use goreleaser for releases

We should use goreleaser for releases.
The following would probably need to change...

Change the Dockerfile to work with goreleaser.
Change Github actions to run gorleaser when a semver tag is created.

Of course, and as you said on #7, goreleaser can be used in GitHub Actions, so goreleaser can build the Docker image right?

Yeah. I will work on this one.


System.OutOfMemoryException was thrown

NLog version: (e.g. 4.4.13)
4.7.11
Platform: .Net 3.5 / .Net 4.0 / .Net 4.5 / Mono 4 / Xamarin Android / Xamarin iOs / .NET Core 1 / .NET Core 2 / .NET Core 3
.Net 4.5
Current NLog config (xml or C#, if relevant)
FilePath = filePath;
var config = new NLog.Config.LoggingConfiguration();

// Targets where to log to: File and Console
var loggerName = "ExecutionContextAsyncLogger";
var logfile = new NLog.Targets.FileTarget(loggerName)
{
	FileName = filePath,
	KeepFileOpen = true,
	Encoding = Encoding.UTF8,
	Layout = "${message}"
};

AsyncTargetWrapper wrapper = new()
{
	WrappedTarget = logfile,
	QueueLimit = 10000,
	BatchSize = 5000,
	TimeToSleepBetweenBatches = 100,
	OverflowAction = AsyncTargetWrapperOverflowAction.Discard
};
wrapper.LogEventDropped += (s, e) => GlobalLogEventDropped.Invoke(s, e);

// Rules for mapping loggers to targets
config.AddRule(NLog.LogLevel.Info, NLog.LogLevel.Fatal, wrapper);

What is the current result?
Our windows form applications crashed sometimes.
We have 400+ windows form application, and they run all day.  It looks good when we changed log package form log4net to Nlog. But we found some application crashed after it run 4 days. Exception message shows out of memory, and we check windows memory usage is 36%.

What is the expected result?
NLog or my process could handle excpetion and don't let it make process crashed.

Please post full exception details (message, stacktrace, inner exceptions)

System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.IO.MemoryStream.set_Capacity(Int32 value)
   at System.IO.MemoryStream.EnsureCapacity(Int32 value)
   at System.IO.MemoryStream.SetLength(Int64 value)
   at NLog.Internal.StringBuilderExt.CopyToStream(StringBuilder builder, MemoryStream ms, Encoding encoding, Char[] transformBuffer)
   at NLog.Targets.FileTarget.RenderFormattedMessageToStream(LogEventInfo logEvent, StringBuilder formatBuilder, Char[] transformBuffer, MemoryStream streamTarget)
   at NLog.Targets.FileTarget.WriteToMemoryStream(IList`1 logEvents, Int32 startIndex, MemoryStream ms)
   at NLog.Targets.FileTarget.Write(IList`1 logEvents)
   at NLog.Targets.Target.WriteAsyncThreadSafe(IList`1 logEvents)
   at NLog.Targets.Target.WriteAsyncLogEvents(IList`1 logEvents)
   at NLog.Targets.Wrappers.AsyncTargetWrapper.WriteEventsInQueue(Int32 batchSize, String reason)
   at NLog.Targets.Wrappers.AsyncTargetWrapper.ProcessPendingEvents(Object state)
   at System.Threading.TimerQueueTimer.CallCallbackInContext(Object state)
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.TimerQueueTimer.CallCallback()
   at System.Threading.TimerQueueTimer.Fire()
   at System.Threading.TimerQueue.FireNextTimers()
   at System.Threading.TimerQueue.AppDomainTimerCallback()

Are there any workarounds? yes/no
no

NLog 4.7.13 has been released: https://www.nuget.org/packages/NLog/4.7.13

@snakefoot  I have tried the NLog 5.0 Preview 3 and that works fine. No crash as far as we monitor.

@qwas368 Thank you for the confirmation, that NLog 5.0 resolves the issue. Hopefully we will soon have NLog 5.0 RTM.


Open in Excel

We have installed BC Spring CU04 No on-prem at client site. The customer i running his own AD and not using Azure AD. When we run the the action "Open in Excel" from the web client it opens the Excel with the data from the page but the user is not be able to use the Refresh button. The same action works from the RTC client and the user can choose to Refresh and the data are refreshed.  Our problem/question is it the correct functionality that the Refresh button is disabled when we run the action from the web client or do we have some configuration issue?

I sent the same request through the documentation feedback. So I close this issue.


Add optional ordered tabs

I found that it was impossible to create custom shorthands that can tab in any order, so I added a way to define the order to go through the #tabs.
For example: \left#cursor #tab \right#tab would always tab to the middle instead of the second tab, which is annoying and does not make sense for this custom shorthand.
To fix this, I added a way to optionally define the order of the tabs like this:
\left#cursor #tab2 \right#tab1
This will first tab to #tab1 and then to #tab2.
Other example: \binom{#tab45}{#cursor}#tab12#tab999 would go to #cursor, then to #tab12, then to #tab45, and finally to #tab999 (the numbers are chosen in increasing order).
The normal #tabs still work for backwards compatibility, the only difference being that they are now searched from the start of the current line instead of after the cursor's position (which shouldn't be a problem since all previous custom shorthands had to have the #tabs after the #cursor.
The description for the custom shorthand parameters in the settings was also updated to explain this addition.

@pokir Thank you so much!!! That's a really great addition! Will publish this merge in the immediate version update.


Example of SF HTTP cache tagging

Q
A

Bug fix?
no

New feature?
yes

BC breaks?
no

Deprecations?
no

Fixed tickets
fixes #issuenum

Related issues/PRs
#issuenum

License
MIT

Documentation PR
sulu-io/sulu-docs#prnum

What's in this PR?
This PR shows an example implementation of the Symfony HTTP cache library.
It allows tag invalidation with the Symfony HTTP Cache.
Why?
Although the user can currently use tag invalidation with the Varnish caching server, allowing content to be cached "forever" until it is invalidated, this option is not available with the easier-to-install Symfony (native PHP) HTTP Cache.
Example Usage
As in this PR.

There is also https://github.com/sulu/sulu/pull/2148, both PRs are handling caching. Which one is the latest? Can one of them be closed?

@danrot both are required