Automatic cleanup!

This repo also has a manually managed README. Blacklisting it too.

@rictic What would the auto-generated README look like? Our manually managed one is just a basic placeholder, so we might want the auto one anyway.

The auto-generated READMEs are based on per-element docs that hydrolysis extracts. e.g. https://github.com/PolymerElements/paper-input/blob/master/README.md
The auto-generator doesn't produce anything useful for repos that just gather up other repos, like paper-elements, iron-elements, platinum-elements, etc.
If there is something that it could generate that would be useful I'd be happy to write it, or if you like you can contribute the cleanup bot, tedium!

@rictic Ah, no,got it, didn't spot that this was the collection repo rather than an element.
One possible suggestion would be something like:
This element provides a convenient way to import a collection of other elements:

<platinum-sw>
...

But it's not particularly important.


Mock method with move type argument calls copy constructor

Hi!
I'm using Turtle to mock a class that has a method which takes a moveeable type with no copy constructor. In my case this is a simple function as such:
class IMyClass
{
   public:
      virtual void Function(std::unique_ptr<IArgument> argument) = 0;
};

For which I am mocking it as such:
MOCK_BASE_CLASS(MockIMyClass, IMyClass)
{
   MOCK_METHOD(Function, 1);
};

Trying to set up an expectation for this function causes the deleted copy constructor to be called, which does not compile. E.g.:
MockIMyClass myMock;
MOCK_EXPECT(myMock.Function).calls([](std::unique_ptr<IArgument> argument) { ... });

I can work around this by making a detour through
MOCK_BASE_CLASS(MockIMyClass, IMyClass)
{
   void Function(std::unique_ptr<IArgument> argument) override
   {
       MockFunction(argument);
   }
   MOCK_METHOD(MockFunction, 1, void(std::unique_ptr<IArgument>&));
}

and make my expectation lambda on the MockFunction mock.
I saw that there were some related commits made in the repo three weeks ago, which got my hopes up. However, the unit test attached only tests the MOCK_FUNCTOR being possible to mock expect using a lambda with a unique pointer, but not a member function as in my case.
Hoping for some guidance (but tbh I can manage with the work around for now).
Best regards,
Christopher

Hi and thanks for your fast reply!
Actually I did see those fixes on master and tried my use case with the tip of master of yesterday (merge of #40). Problem is that the deleted copy constructor is now called already in the MOCK_METHOD declaration of the mock.
Here's a failing Boost test case that I'm running towards #41 (tip of fix-c++17-compliance):
class IClassWithMove
{
public:
    virtual void Function(std::unique_ptr<int> argument) = 0;
};

MOCK_BASE_CLASS(MockIClassWithMove, IClassWithMove)
{
    MOCK_METHOD(Function, 1);
};

BOOST_AUTO_TEST_CASE(TestClassWithMove)
{
    MockIClassWithMove mock;
    MOCK_EXPECT(mock.Function).once().calls([](std::unique_ptr<int> argument) {
          BOOST_CHECK(*argument == 1);
    });

    auto ptr = std::make_unique<int>(1);
    dynamic_cast<IClassWithMove&>(mock).Function(std::move(ptr));
}

On the line of MOCK_METHOD(..) this gives me:
error C2280: 'std::unique_ptr<int,std::default_delete<_Ty>>::unique_ptr(const std::unique_ptr<_Ty,std::default_delete<_Ty>> &)': attempting to reference a deleted function

Thanks for your support!
Best regards,
Christopher

I see, thanks for the test case, I'll take a look as soon as possible!

This should be fixed, do not hesitate to re-open if needed !

Thanks for fixing this so quickly!
Best regards,
Christopher


Openstack subnet show got error "'NoneType' object is not iterable"

Openstack subnet show  got error: 'NoneType' object is not iterable.
Using Openstack horizon to show subnet also got
Danger: An error occurred. Please try again later.

Impact Horizon UI and CLI.

The contract returned by subnet manager is incorrect.

Modify following fields in the subnet entity to array: dns_nameservers, service_types and host_routes.
Modify start_ip and end_ip in the application_pools field to start and end.

The PR solved this issue is the following:
https://github.com/futurewei-cloud/alcor/pull/438


Add BK Berliner Platz

URL of a page on the official website where an IT-related long-term course is offered: https://www.bk-berliner-platz.de/bildungsangebote/bildungsgaenge-des-dualen-systems-der-berufsausbildung/
An URL of a page or another proof showing that the university recognizes the domain which you are submitting as an official email domain for the students: (I don't really know how to proof, emails for student were only recently introduced for some students to register educational software. So i guess the only proof I could offer is a screenshot of my email account...)

@geleebohne Pull request merged. Thank you!


HTTPS for Geo Location and Open Weather API Conflicts

Challenge Show the Local Weather has an issue.
User Agent is: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36.
Please describe how to reproduce this issue, and include links to screenshots if possible.
Chrome has deprecated Geolocation in JavaScript unless it's being ran in a secure enviroment (localhost, or HTTPS). However, Open Weather API requires you to pay for HTTPS access. Basically, the conflict is to use Open Weather API AND Geolocation, you need payed access to the Open Weather API.

@helloitsian thanks for the issue. This is a known issue in #8988 and #9079. I think https://github.com/FreeCodeCamp/FreeCodeCamp/pull/10341 fixes both issues. Take a look at the changes and discussion on those pages for some possible solutions. Happy coding!


shellcheck linter reports an error when there are only warning and info messages

If shellcheck gives 2 warnings and 1 info message when linting a bash file it reports that the bash file has an error.  Warnings are not errors.
2023-07-12 20:17:33 [INFO]   Linting [BASH] files...
2023-07-12 20:17:33 [INFO]   ----------------------------------------------
2023-07-12 20:17:33 [INFO]   ----------------------------------------------
2023-07-12 20:17:33 [INFO]   ---------------------------
2023-07-12 20:17:33 [INFO]   File:[/github/workspace/bin/run_karate_image.sh]
2023-07-12 20:17:33 [ERROR]   Found errors in [shellcheck] linter!
2023-07-12 20:17:33 [ERROR]   Error code: 1. Command output:
In /github/workspace/bin/run_karate_image.sh line 50:
CMD="docker run --net=host $tokenenv $hostenv $portenv $dynenv  --rm -t -v $PWD:/project $IMAGE:$VERSION bash -c "cd /project && java $configpath -jar /karate.jar -T $PARALLEL -o $output_dir -f junit:xml $features $TAGS""
^-----------------------------^ SC2089 (warning): Quotes/backslashes will be treated literally. Use an array.
In /github/workspace/bin/run_karate_image.sh line 51:
echo $CMD | bash
^--^ SC2090 (warning): Quotes/backslashes in this variable will not be respected.
^--^ SC2086 (info): Double quote to prevent globbing and word splitting.

Is there any update on this? If it is all about the strict checks, is there a way to disable it?

Hi @troyane !
You can set the Shellcheck severity with the BASH_SEVERITY environment variable. If you don't set it, shellcheck uses its default.
See the super-linter README for details.

@ferrarimarco thanks a lot! It was a bit unintuitive that the default value for severity is style.


ValidationError: "version" is required, while I provided the version

Affected repo: https://github.com/fiftydinar/gnome-shell-extension-openweather

My mistake, nothing to see here


Reminder test

Codecov Report

Merging #134 (0a99fdb) into master (f6e3040) will increase coverage by 1.22%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master     #134      +/-   ##
============================================
+ Coverage     60.55%   61.78%   +1.22%
- Complexity      508      523      +15
============================================
  Files           102      102
  Lines          1871     1871
  Branches        200      200
============================================
+ Hits           1133     1156      +23
+ Misses          664      636      -28
- Partials         74       79       +5

Impacted Files
Coverage Δ

.../java/seedu/address/model/util/SampleDataUtil.java
18.75% <ø> (ø)

...rc/main/java/seedu/address/model/ModelManager.java
72.36% <0.00%> (+5.26%)
:arrow_up:

...va/seedu/address/logic/commands/RemindCommand.java
78.57% <0.00%> (+78.57%)
:arrow_up:

...u/address/model/meeting/ReminderDatePredicate.java
80.00% <0.00%> (+80.00%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f6e3040...0a99fdb. Read the comment docs.


[Bug]: Auto save modal - on editing a form and clicking cancel, auto save modal does not come up.

Is there an existing issue for this?

[X] I have searched the existing issues

Description
When I edit a DS page and then click cancel, the autosave modal does not come up.
Steps To Reproduce

Configure Prod and Staging environments for say Mongo DS
Now Go to Edit DS page and edit the prod or staging config. Click Cancel
No autosave dialog is seen
As per original behavior on Release, cancel after edit also invokes the auto save dialog.
Slack thread discussion

Public Sample App
No response
Environment
Deploy Preview
Issue video log
https://ddpa7mfuvv.vmaker.com/record/SKT16aCvWUxi5Ybg
Version
Cloud

As per above slack thread discussion, if we have made any changes in the edit ds page config, on clicking cancel, auto save dialog should come up. As of now it does not.
This needs to be discussed with PM and Integ pod and then based on discussion, changes need to be done? Is that right? @ayushpahwa ?

Bug stands invalid as cancel button itself is going to be removed going forward. Refer zeplin - [zpl://screen?pid=64625d3b10e89f250522275f&sid=6462629328ff802461d1f064]


3.x

Let's start with the 3.x release by making it master.

Hey @timostamm I was wondering if you planned on upgrading RXJS to ^7.x in protobuf-ts/angular-runtime before making the 3.x release. I'm running into peer dependency conflicts, as I'm running NG14 and need features of the latest version of RXJS. I wanted to make sure before you made your next major release.

@timostamm If you'd like, I can go ahead and update the dependency for RXJS. protobuf-ts/angular-runtime is a peer dependency of our project, so in order to move forward with newer versions of Angular, the version of RXJS will need updated.


ctapipe-fileinfo

Just a small fast command-line utility to display information about ctapipe output files.

the output is all reference headers in YAML format  (hierarchical by default, but a --flat option is available)
you can optionally write an index table for all files with all headers as columns (uses pandas DataFrame's ability to convert a list of dicts into a table, and then uses astropy.table to write it to any format you want, e.g. files.fits or files.ecsv)
files not in hdf5 format are skipped (with a message)
incomplete hdf5 files will return {} (no header)
you can colorize the output by piping it through pygmentize -l yaml

Help:
% ctapipe-fileinfo --help

usage: ctapipe-fileinfo [-h] [--output-table OUTPUT_TABLE] [--flat] FILENAME [FILENAME ...]

    Display information about ctapipe output files (DL1 or DL2 in HDF5 format).
    Optionally create an index table from all headers

positional arguments:
  FILENAME              filenames of files in ctapipe format

optional arguments:
  -h, --help            show this help message and exit
  --output-table OUTPUT_TABLE
                        generate output in tabular format (default: None)
  --flat                show flat header hierarchy (default: False)

Example 2:
%  ctapipe-fileinfo *.DL1.h5

proton_20deg_0deg_run153___cta-prod5-paranal_desert-2147m-Paranal-dark_merged.DL1.h5:
    CTA:
        ACTIVITY:
            ID: eb09130c-1a4e-4a0a-96a0-2607ebca70b1
            NAME: ctapipe-merge
            SOFTWARE:
                NAME: ctapipe
                VERSION: 0.10.5
            START:
                TIME: '2021-03-15 15:30:01.948'
            TYPE: software
        CONTACT:
            EMAIL: ''
            NAME: ''
            ORGANIZATION: CTA Consortium
        INSTRUMENT:
            CLASS: Subarray
            ID: MonteCarloArray
            SITE: Other
            SUBTYPE: unspecified
            TYPE: unknown
            VERSION: unknown
        PROCESS:
            ID: '0'
            SUBTYPE: ''
            TYPE: Simulation
        PRODUCT:
            CREATION:
                TIME: '2021-03-15 15:30:57.161'
            DATA:
                ASSOCIATION: Subarray
                CATEGORY: S
                LEVEL: DL1
                MODEL:
                    NAME: ASWG DL1
                    URL: ''
                    VERSION: v1.1.0
            DESCRIPTION: Merged DL1 Data Product
            FORMAT: hdf5
            ID: 98f44cd6-f642-4af0-aa55-7da1621f0c5e
        REFERENCE:
            VERSION: '1'

Example of table output:
ctapipe-fileinfo --output-table index.fits

Note that this also lets us collect some stats on processing time, for example:


Fix access to currentUserNotificationSettings from non-ui threads

Fixes #826
I've verified in our app that this indeed fixes the problem ☺

Awesome, thanks for the quick pull!
@jkasten2 would it be possible to cut a release with this so that we can use it in our app?


Use fixed test databases. Test on 1.3, 1.4, and tip

This should hopefully help fix the Travis build problems and make it easier for other people to run the tests.

That's awesome -- I didn't know about the test databases. Or did you make them?

We include them with many of the MaxMind Legacy APIs.


Question about Converting Bitmap to imageData

This program make it a lot easier for me to incorporate the yolov3 tiny into my c# project. Thanks a lot.
My images from video is in Bitmap format. What is the best way to convert Bitmap image to imageData to be used in "yoloWrapper.Detect(imageData);".
Do you have a function that use Bitmap or Image as input?
I notice the function in yoloWrapper.cs:
[DllImport(YoloLibraryGpu, EntryPoint = "detect_mat")]
internal static extern int DetectImageGpu(IntPtr pArray, int nSize, ref BboxContainer container);

Hey, I'm a noob here but may be it could help you. It's possible to provide image data as byte array. I save image into memory stream and convert it into array with ToArray().

Make bitmap to image byte array using memorystream
Here is sample.
bitmap image;
byte[] imgByteArray;

                    using (var stream = new MemoryStream())
                    {
                        image.Save(stream, System.Drawing.Imaging.ImageFormat.Jpeg);
                        imgByteArray = stream.ToArray();
                    }

                    var items = yoloWrapper.Detect(imgByteArray);


Several pre-processing issues

During the course last week we found several issues with preprocessing:

Preprocessing operations do not always return float32. I have hot-fixed this for the example models. Also, #180 might fix this for zero-mean-unit-variance, but it would be good to fix this for all preprocessing.
Pre-processing yields incorrect results for wrong image dtype, for example https://bioimage.io/#/?id=10.5072%2Fzenodo.881973 yields correct results for uint8 inputs, but incorrect ones for uint16
Would be good to have more CI for this...

Maybe cast should be injected in make_preprocessing  as a last step, to ensure that the type is the same after all the steps.
It's also possible to inject first step, but it's unclear what method should be used for lossy conversion and how it should be communicated to user.

that's an interesting problem. Reading this it looks almost like one would have to enforce/encourage/recommend usage of preprocessing that does not directly introduce such issues. Like always doing some kind of normalization (range, and dtype). How limiting would this actually be for network developers?

What is the expectancy when coming with uint16 instead of uint8?

One option would be to have implicit preprocessing that transforms to the specified datatype and data range. For sure this has also some pitfalls.
I think we have these options:

Add the implicit preprocessing
Provide a warning if the data provided does not match the data specified

This could also be combined, i.e. warn if the data doesn't match and then transform it.

maybe we could mandate in the spec that every preprocessing includes a normalization or  a type casting (and no value tranforming preprocessing steps preceding it)?

I don't think that this problem is solvable with the spec only. It's a runtime issue where we receive the data with insufficient information about the properties of the incoming image.
Maybe this kind of normalization should be prompted on ilastik side so users can decide what to do with it.
Especially considering that we only see one block here.

I don't think that this problem is solvable with the spec only. It's a runtime issue where we receive the data with insufficient information about the properties of the incoming image.
Maybe this kind of normalization should be prompted on ilastik side so users can decide what to do with it.

I agree, we will most likely not be able to solve all corner cases, but having something that works most of the time (and issues a warning if it's unclear if the preprocessing will do the right thing) would already be quite helpful.
Enabling user preprocessing would of course be good, but I am not quite sure what's the best strategy for this.

Especially considering that we only see one block here.

That's another important point, which I forgot to bring up in the initial issue: we need to enable per data-set (i.e. image or volume) preprocessing for zero-mean-unit-variance, because the values estimated from a single block are too noisy.

I'm not sure what CI would help there.

@k-dominik: I just saw your comment here. And I was not quite clear in my initial description: there were some cases in which the preprocessing returned a non float32 value and for which applying the model then failed.
(I have added casting to float32 in the model as a hotfix for this, but this is ofc not something we can rely on).
These cases could be caught by CI; there could be CI that ensures float32 output for various inputs.

Current behavior is up to spec (as in not specified what should happen): https://github.com/bioimage-io/spec-bioimage-io/blob/main/supported_formats_and_operations.md#preprocessing
I propose we first specify expectations of preprocessing in terms of dtypes (in/out) and then try to fix the implementation and test for those specifications.

Current behavior is up to spec (as in not specified what should happen): https://github.com/bioimage-io/spec-bioimage-io/blob/main/supported_formats_and_operations.md#preprocessing

Indeed, it's not specified in the spec; but at least for all preprocessing it should return float32; this was long discussed in one of the meetings quite a while ago already.

closing this, since preprocessing is now part of bioimageio.core


Creating payment with customers.

The ID of every customer is a String value. This causes an error everytime someone tries to make a payment with customers because the field "payer.id" requieres an Integer. Although if you put that String in the same field and send the request manually via a HTTP REST client, the payment is processed perfectly.
The error recibed is this one:
Error: The next fields are failing n validation: ".payer.id": should be integer.      at Object.requestManager.buildRequest (/app/node_modules/mercadopago/lib/request-manager.js:270:17)      at Object.<anonymous> (/app/node_modules/mercadopago/lib/request-manager.js:302:18)      at Promise._execute (/app/node_modules/bluebird/js/release/debuggability.js:300:9)      at Promise._resolveFromExecutor (/app/node_modules/bluebird/js/release/promise.js:481:18)      at new Promise (/app/node_modules/bluebird/js/release/promise.js:77:14)      at Object.requestManager.exec (/app/node_modules/mercadopago/lib/request-manager.js:296:10)      at /app/node_modules/mercadopago/lib/request-manager.js:106:31      at tryCatcher (/app/node_modules/bluebird/js/release/util.js:16:23)      at Promise._settlePromiseFromHandler (/app/node_modules/bluebird/js/release/promise.js:510:31)      at Promise._settlePromise (/app/node_modules/bluebird/js/release/promise.js:567:18)      at Promise._settlePromiseCtx (/app/node_modules/bluebird/js/release/promise.js:604:10)      at Async._drainQueue (/app/node_modules/bluebird/js/release/async.js:138:12)      at Async._drainQueues (/app/node_modules/bluebird/js/release/async.js:143:10)      at Immediate.Async.drainQueues (/app/node_modules/bluebird/js/release/async.js:17:14)      at runCallback (timers.js:649:20)      at tryOnImmediate (timers.js:622:5)

Thanks @guidotajan , the problem is solved. This package is in beta yet, but, use it!, this is the most updated SDK for NodeJS.
If you are using this dependency referencing the Repository on the package.json remove the node_modules/mercadopago and do a "npm i" again.
The NodeJS SDK validates the JSON before sending it, that's was the issue. If you encounter any problem like this, please, open another issue and we will fix it 👍


Add more \l REPL commands.

Add \lm [PATTERN] command for listing modules, optionally filtered by
name using the specified regexp pattern.
Add \lmI [PATTERN] command for case-sensitive pattern matching.
Add \lr [PATTERN] command for listing roles, also with option to
filter by name using regexp.
Add \lrI [PATTERN] command for case-sensitive pattern matching.
The PATTERN is purely regexp, it should not be quoted in any way, but
instead will be treated as a raw string for a regexp search.
Issue: #179.
Co-authored-by: Eduardo Schettino<EMAIL_ADDRESS>

Special thanks to @schettino72 on whose PR #672 this work is based.


specify requests versions that should be avoided

see obspy/obspy#1599

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

Ok, this will likely be obviated by obspy/obspy#1612 and obspy/obspy#1614.

No need for this anymore, upcoming releases are working with those requests versions just fine.


Video not playing on 7.0 and above

After record Its playing only audio, video not showing up on 7.0 and above versions.

Same problem here :(

@jaderalcantara I am facing on samsung devices only, Your side??

on S7 Samsung device.
Em seg, 24 de set de 2018 às 02:36, majidalik<EMAIL_ADDRESS>escreveu:

@jaderalcantara https://github.com/jaderalcantara I am facing on
samsung devices only, Your side??
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/googlesamples/android-Camera2Video/issues/90#issuecomment-423880435,
or mute the thread
https://github.com/notifications/unsubscribe-auth/APebnRzOfepYgmMGgh_-rX5O1OFLr4kTks5ueG9GgaJpZM4WhYHk
.

--
Jader Alcântara
Mobile Developer
+55 41 97771819

same on samsung s7

记录后它只播放音频，视频不显示在7.0及以上版本。

Is there a solution now?

This sample has been migrated to a new location (check README for more information).
As recommended by GitHub, we are closing all issues and pull requests now that this older repo will be archived.
If you still see this issue in the updated repo, please reopen the issue/PR there. Thank you!


feat: implement OAuth for catalog rest client

Resolve #238
The docker image of tabular doesn't support credential settings, so it's impossible to write a test.
I just test it manually using their hosted iceberg service.

Resolve #238
The docker image of tabular doesn't support credential settings, so it's impossible to write a test.
I just test it manually using their hosted iceberg service.

Is there any way to extend the Dockerfile with the Env for credentials?

Is there any way to extend the Dockerfile with the Env for credentials?

I can't find any codes about OAuth in the image. Only an open issue seems related.
https://github.com/tabular-io/iceberg-rest-image/issues/27

BTW, is it possible to update examples so that users could try in?

Hi, @TennyZhuang Thanks for this pr! It looks great, but there are something missing:

We should try to refresh token when error happens
Please make the property names constants.

Hi, the implementation is mainly copied from an old python implementation about 5 months ago, which is referenced by your issue. I think the most naive implementation can make the PR easier for review.
In that version you referred, token refresh is not implemented.

In that version you referred, token refresh is not implemented, I prefer to add it in later PR, what do you think?

Sounds reasonable to me.

BTW, is it possible to update examples so that users could try in?

Will do that after support refresh token.

@TennyZhuang @flyrain  once this is merged, I can make the changes for scope, and other optional param in a followup PR.

I think the PR is ready for review as a minimal implementation.


Empty string '' for subdomain

Hello!
I have the question about reverse function.
reverse have following check:
    domain = get_domain()
    if subdomain is not None:
        domain = '%s.%s' % (subdomain, domain)

But if subdomain is empty string (''), then we get domain equals to .examle.org, what completely doesn't have sense.
So maybe changing check to
    domain = get_domain()
    if subdomain:
        domain = '%s.%s' % (subdomain, domain)

will be better? If subdomain is empty string, then we use main domain. Everyone is happy!
In my code I add subdomains dynamically and sometimes I need to reverse them. Empty subdomain is my main page and I want to resolve it to main domain.
Thanks!

I believe that this is the issue that I ran into. It is fixed by pull request #54. The issue is that there is a check:
if subdomain is '':

which I changed to:
if subdomain == '':

since the object 'subdomain' is a Django class, rather than a plain string.

@jbmmhk
Looks like different issues for me. But your fix looks absolutely reasonable for me and I hope that @tkaemming will merge it eventually.

the object 'subdomain' is a Django class, rather than a plain string.
Not exactly. If you look there
https://github.com/tkaemming/django-subdomains/blob/master/subdomains/middleware.py#L39
request.subdomain contains string from matched regexp.

You are correct that the issue is separate from mine, the issue that I ran into was in regards to the reverse template tag. (In which case the 'subdomain' string is a SafeString from Django).

@jbmmhk didn't thought about SafeString. Thanks for the explanation!


dnstap log file not populating for every entry even if repeated.

Not sure if this belongs here or somewhere else, so let me know if my question / problem needs to be redirected.
When running dnstap I noticed the binary log only populates when new entries are requested from the named server. Is this expected?
Trouble shooting:

On bind server make sure dnstap is running, then start the named service.
Can see the dnstap log gets created, and populated properly on named start up.
Perform a dig request from a remote client for an entry in the zone db (test.domain.internal). I am performing a watch ls -l on the dnstap file, and see the file increase in size.
Also monitoring the bind.log file, I see the request come through.
Perform the same exact dig request (test.domain.internal) from the same remote client to the same named server running dnstap. The bind.log populates with the request, the dnstap log does not increase in size.
Perform a new request with a different domain (www.internet.com). I see the bind.log populate, then the dnstap log increases in size.
I use dnstap-read (memory flag) on the file, and can see the CQ entries for the original request (test.domain.internal), the duplicate request (test.domain.internal again), and then the external domain request (www.internet.com).

I was thinking the log would populate for every request no matter how frequent or similar they are. Was there a reason this was disabled? Too much overhead?
Is there a way to enable this feature?

The dnstap program does not do any deduplication or similar of the messages it receives, but it does use a buffered output when writing to a file. In test setups with low query volumes, this will lead to some queries not being written to the dnstap output file until a subsequent query triggers a buffer flush.
If the duplicate query eventually makes it to the dnstap file, this is probably what is going on. If not, this may take further investigation.

@cmikk thanks for the quick response.
We plan to use DNSTAP on bind servers that will received very high volume of forwarding traffic. To confirm, it sounds like dnstap log output is not guaranteed, is that true? Can you share more details on your query volume tests? I would like to mimic with our Ixia test system.

The current version of the dnstap program in this repository (version 0.3.0) makes every effort to write all data it receives to a destination file or socket. Some earlier versions (prior to 0.2.2) attempted to make this write non-blocking but this interacted poorly with the buffering implementation of a specific dnstap producer, so we backed this out in 0.2.2; all writes to any destination are blocking.
Dnstap producers, on the other hand, are encouraged to drop dnstap data rather than block query processing attempting to export it. In this sense, delivery of dnstap data is not guaranteed, but loss can be reduced through faster (or more minimal) processing.
The most recent volume tests we've done have used resperf to repeat a query at a selected rate and concurrency against the server under test exporting CLIENT_QUERY reports on a unix domain socket and writing to a regular file. Note that we have not run this setup recently with BIND, but did so with CoreDNS in the process of investigating issue #34.

does use a buffered output when writing to a file

It would be nice to have some control over it.
Like disable buffering, flush buffer every n seconds, handle signal to flush buffer or something like this.
Right now even buffer flush on exit is missing (tried 0.4.0) which is really disappointing


[openvino] update to 2024.2.0

Library name
openvino
New version number
2024.2.0
Other information that may be useful (release notes, etc...)
No response

The port has been updated in #39383
Please try with latest vcpkg.

The port has been updated in #39383
Please try with latest vcpkg.

Thank you, but when I updated the vcpkg master branch and installed openvino static, it failed!
vcpkg install openvino:x64-windows-static failed!


Add test dataset for built-in rules in gitleaks.toml

Current gitleaks.toml  has tons of rules, and more are coming with PRs:

add rule for DSA keys #276

It might be a reasonable idea to add a test dataset to ensure that these rules work as expected.
For example:

create a new repository called "gitleaks-dataset"
create folders to represent every rule
within these folders, add two files: data.txt and whitelisting.txt
fill these files with examples of secrets on which target rule is expected to trigger
then run gitleaks against this test dataset; we know how many occurrences of a particular rule should be, assert that in a simple script, integrate with CI build

That way, new rules can be tested against test dataset every CI build. This gives assurance on rules and provides a quick way to test and enhance old and new rules.
Potentially, that can also close this ticket:

Ability to define positive/negatives datasets for rules? #256

For instance:
 {
  "Description": "Ionic API token",
  "StartLine": 793,
  "EndLine": 793,
  "StartColumn": 30,
  "EndColumn": 75,
  "Context": "class Google_Service_Prediction_AnalyzeModelDescriptionConfusionMatrixRowTotals extends Google_Model",
  "Secret": "ion_AnalyzeModelDescriptionConfusionMatrixRowT",
  "Entropy": 0,
  "Tags": [],
  "RuleID": ""
 },

This is a class name with entropy 0 which is a false positive from Gitleaks 8.0.4.

The cmd/generate package effectively does this. You can define false positives and true positives to test rules against


Add shard not owned error

NOTE: This PR: https://github.com/uber/cadence-idl/pull/179 needs to be merged before this one. This one then needs to be updated to reference the correct commit on the main branch in the IDL repo.

What changed?

Added a new error type returned from matching, TaskListNotOwnedByHostError in thrift and proto IDLs
We do not log errors on this error as it's an expected transient error

Why?

We have to propagate the error type over the wire so we can check the error type on the history side, to be able to handle it gracefully.
We should not have error logs on this error as it is expected and transient.

How did you test it?

Unit tests
Deployment in staging environment

Potential risks

Release notes

Documentation Changes

@jakobht does it require specific order or rollout? Like frontend,history being rolled out before matching?
How Cadence clients react to this error? I expect this to be only within history<->matching and frontend<->matching. What frontend returns to clients as the result of hitting this error twice - no tasks?

@dkrotx Ideally it would be frontend -> history -> matching.
But we will just get some log spam if not - so it's safe to do in any order. I don't think it's worth it to do any custom rollout.


Messaging: Changelog email + Startup program email +  YC program email

We recently made a changelog post announcing our Traceloop integration for LLM apps. Please can you also include it in the next Changelog email + Startup program email +  YC program email.
If it's helpful, below is suggested copy. Also, here is a PDF of the previous announcement you did for the Langfuse integration – we can do something similar.
Title: Track metrics for LLM products using our Traceloop integration
Text: We've teamed up with Traceloop to launch a new beta for monitoring LLM apps. You can use it to track metrics such as model costs, latency, token usage, and more. Head to the docs to find out more.
Image:

Next one is delayed for a little while so we can include the data warehouse, replay price cuts, and anonymous events news in there - so it'll be a pretty packed issue. I've added this info to the calendar event I use for organizing this, so we can close this issue in the mean time. I'll take care of it.


Updated mongoose, i18n, element-ui, webpack, vue, vue-router

Packages updated to latest versions:

mongoose
i18n
element-ui
vue

Updated nginx config

Failed to update to<EMAIL_ADDRESS>- vue css is not working.
It is necessary to wait a little when to appear vue-loader@15 or extract-text-webpack-plugin@4.

I have working files for<EMAIL_ADDRESS>But I was not able to connect the vue css.

What's the problem in detail?

Vue Devtools should not be available In the production mode
In the production mode must be
Vue.config.devtools = false
`

Add this in client/main.js

Thank you. Can I sign a contract with you to work on my vue project?

Yes, I want to develop a project based on your template - Media Player Management Portal. It will be necessary to develop vue-components for the media library. It is possible that it is more profitable to use you to develop a front-end.

This template's license is MIT, so just use for any project. And it's welcome to share your project's repo or any website to me.

check your email

my email is<EMAIL_ADDRESS> please send msg


Deletions are not getting committed to the gh-pages branch

Issue moved to GSS-Cogs/csv-to-csvw-action #8 via Zenhub


Internal error

Hi @ziga104. Can you give us info on what is your issue?

Unfortunately that is not enough information to help you with your problem. If you could open a new issue while filling in the issue template and providing the internal error details then we can try to help address your issue.


DL: Improve parameter parsing and add unit tests

JIRA: MADLIB-1336
This commit ensures that metrics parameter can be skipped by the user.
It also enforces that optimizer and loss are required.
This commit also fixes the fit params parsing to allow NULL (no user defined
fit params)

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/875/

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/877/

The failing unit-test will be fixed by the https://github.com/apache/madlib/pull/383

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/878/

@njayaram2
PR is to be re reviewed. We add a few more unit tests that will cover the test cases for convert_string_of_args_to_dict

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/887/

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/889/

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/890/

I guess I am not clear on what are mandatory params and what are optional params, and how errors are handled.
(1)
regular test
DROP TABLE IF EXISTS model1, model1_summary;
SELECT madlib.madlib_keras_fit('mnist_train_packed',  -- source_table
                               'model1', -- model
                               'dependent_var',
                               'independent_var',
                               'model_arch_library',  -- model_arch_table
                               1,  -- model_arch_id
                               $$ loss='categorical_crossentropy', optimizer='adam', metrics=['acc'] $$,  -- compile_params
                               $$ batch_size=128, epochs=4 $$,  -- fit_params
                               5,  -- num_iterations
                               0,  -- gpus per host
                               NULL,  -- validation_table
                               'Frank',  -- name
                               'A test model'  -- description
                              );

INFO:  Processed 30000 images: Fit took 4.37503194809 sec, Total was 5.91591286659 sec  (seg0 slice1 <IP_ADDRESS>:40000 pid=2400)
CONTEXT:  PL/Python function "fit_transition"
INFO:  Processed 30000 images: Fit took 4.39241290092 sec, Total was 5.95022010803 sec  (seg1 slice1 <IP_ADDRESS>:40001 pid=2401)
CONTEXT:  PL/Python function "fit_transition"
INFO:  Time for iteration 5: 8.3350250721 sec
CONTEXT:  PL/Python function "madlib_keras_fit"
INFO:  Average loss after training iteration 5: 0.0441886410117
CONTEXT:  PL/Python function "madlib_keras_fit"
INFO:  Average accuracy after training iteration 5: 0.986333310604

OK
(2)
no metrics param
DROP TABLE IF EXISTS model1, model1_summary;
SELECT madlib.madlib_keras_fit('mnist_train_packed',  -- source_table
                               'model1', -- model
                               'dependent_var',  -- dependent_varname
                               'independent_var',  -- independent_varname
                               'model_arch_library',  -- model_arch_table
                               1,  -- model_arch_id
                               $$ loss='categorical_crossentropy', optimizer='adam' $$,  -- compile_params
                               $$ batch_size=128, epochs=4 $$,  -- fit_params
                               1,  -- num_iterations
                               0,  -- gpus per host
                               NULL,  -- validation_table
                               'Frank',  -- name
                               'A test model'  -- description
                              );

INFO:  Model architecture size: 1KB
CONTEXT:  PL/Python function "madlib_keras_fit"
INFO:  Model state (serialized) size: 0MB
CONTEXT:  PL/Python function "madlib_keras_fit"
ERROR:  plpy.SPIError: KeyError: 'acc' (plpython.c:5038)  (seg1 slice1 <IP_ADDRESS>:40001 pid=3000) (plpython.c:5038)
DETAIL:
Traceback (most recent call last):
  PL/Python function "fit_transition", line 6, in <module>
    return madlib_keras.fit_transition(**globals())
  PL/Python function "fit_transition", line 431, in fit_transition
PL/Python function "fit_transition"
CONTEXT:  Traceback (most recent call last):
  PL/Python function "madlib_keras_fit", line 21, in <module>
    madlib_keras.fit(**globals())
  PL/Python function "madlib_keras_fit", line 173, in fit
PL/Python function "madlib_keras_fit"

Is this the right error?
(3)
no loss param
DROP TABLE IF EXISTS model1, model1_summary;
SELECT madlib.madlib_keras_fit('mnist_train_packed',  -- source_table
'model1', -- model
'dependent_var',
'independent_var',
'model_arch_library',  -- model_arch_table
1,  -- model_arch_id
$$ optimizer='adam', metrics=['acc'] $$,  -- compile_params
$$ batch_size=128, epochs=4 $$,  -- fit_params
5,  -- num_iterations
0,  -- gpus per host
NULL,  -- validation_table
'Frank',  -- name
'A test model'  -- description
);
INFO:  Model architecture size: 1KB
CONTEXT:  PL/Python function "madlib_keras_fit"
INFO:  Model state (serialized) size: 0MB
CONTEXT:  PL/Python function "madlib_keras_fit"
ERROR:  plpy.SPIError: plpy.Error: loss is a required parameter for compile (plpython.c:5038)  (seg0 slice1 <IP_ADDRESS>:40000 pid=3238) (plpython.c:5038)
DETAIL:
Traceback (most recent call last):
PL/Python function "fit_transition", line 6, in
return madlib_keras.fit_transition(**globals())
PL/Python function "fit_transition", line 408, in fit_transition
PL/Python function "fit_transition", line 101, in compile_and_set_weights
PL/Python function "fit_transition", line 274, in compile_model
PL/Python function "fit_transition", line 175, in parse_and_validate_compile_params
PL/Python function "fit_transition", line 96, in _assert
PL/Python function "fit_transition"
CONTEXT:  Traceback (most recent call last):
PL/Python function "madlib_keras_fit", line 21, in
madlib_keras.fit(**globals())
PL/Python function "madlib_keras_fit", line 173, in fit
PL/Python function "madlib_keras_fit"
Is this the right error to throw

(4)
No fit params

DROP TABLE IF EXISTS model1, model1_summary;
SELECT madlib.madlib_keras_fit('mnist_train_packed',  -- source_table
'model1', -- model
'dependent_var',
'independent_var',
'model_arch_library',  -- model_arch_table
1,  -- model_arch_id
$$ loss='categorical_crossentropy', optimizer='adam', metrics=['acc'] $$,  -- compile_params
NULL,  -- fit_params
5,  -- num_iterations
0,  -- gpus per host
NULL,  -- validation_table
'Frank',  -- name
'A test model'  -- description
);
ERROR:  TypeError: cannot concatenate 'str' and 'NoneType' objects (plpython.c:5038)
CONTEXT:  Traceback (most recent call last):
PL/Python function "madlib_keras_fit", line 21, in
madlib_keras.fit(**globals())
PL/Python function "madlib_keras_fit", line 142, in fit
PL/Python function "madlib_keras_fit"
I would have thought that defaults would be used.

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/898/

@fmcquillan99 Thanks for the comments. The scope of this PR has changed a bit. I changed the title to reflect it.

no metrics: The parsing code allows dropping the metrics parameter but a different part of the code still requires it. A future PR will drop that requirement which will fix the issue. Currently, we do require a metric.
no loss: The error message is correct.
no fit: There was a minor bug which should be fixed now. We will allow both NULL and an empty string for fit_params.

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/910/

LGTM


lang: Add versioning to language files

Issue checklist
Note: these are not necessarily requirements

[ ] I have checked existing OPL issues for duplicates and found none @ http://psx-scene.com/forums/official-open-ps2-loader-forum/ & https://github.com/ifcaro/Open-PS2-Loader/issues

Issue description - Describe the problem you are having
Current language system is non-effective and let user use incompatible language between different OPL revisions.
I think add a revision variable on top of each lang and a message about outdated language (just a warning) should make language system better.

Well... It's not a bad idea, but it's in beta-status anyway... so technically users should be aware of these things.

The idea is not bad at all.
I just do not know how this can be sorted out?!
Maybe OPL can check how many strings translation have?
If it has less than e.g. 290 strings, it can alert through notification that current version is not fully compatible\translated?
For some time as a workaround I'm adding in Polish translation version in the comments at the 1st string:
# Wersja 0.20...

Checking for the amount of strings makes less sense then for an entry/string, which defines the Version...

I tested trying to do this a couple weeks ago
https://github.com/KrahJohlito/Open-PS2-Loader/commit/60dea010c286bc4e3d9f7ed8a4502159e874d68f
It works and displays a notification (if enabled) if the Lang version from file doesn’t match defined version in OPL... not sure if it’s the best way to do it though

Sorry for being noob, but this version needs to be determined at start (in\without comments)?
E.g.
#English 0.0.1.
English 0.0.1.
Strings needs to match the last version?
E.g. currently there are 297 strings:
https://github.com/ifcaro/Open-PS2-Loader/blob/master/lng/lang_English.lng.
Or there is an another requirements?

Yerp, probably a bit different than the language-strings itself...
Possibly something like WLE&SMS does with "CNF Version = 1"!

Yea it just opens your Lang file when loading and compares the version numbers
https://github.com/KrahJohlito/Open-PS2-Loader/blob/lang/lng/lang_German.lng#L1
To
https://github.com/KrahJohlito/Open-PS2-Loader/blob/lang/src/lang.c#L18
So the idea is that when Lang files are updated in the repo the Lang version in Lang.c would also need to be updated. They’re just treated as strings though, not sure if it’s the best way.. perhaps using floats or something would be better.. anyway it’s there if anyone else wants to have a play around with it.

So if it is just threaded as string, does it work in first posi3, without rendering the lng's "corrupt"?

Not sure I understood your question completely, but I’ll try answer in a round about way.
It just searches a byte location for the entry, so the version number in the external file will always need to be in the same position otherwise OPL will tell you, you have an outdated version.. All versions still work, it’s just a visual so the user can see if they have the latest version with both the notification and the text ‘version’ itself in the file.

Well...
tl;dr
So you think placing the version in the first line is a "no go"?

You mean the first non commented line? Like, the first string to be translated?
You could but it would break compatibility with older versions etc cause the line numbers would be all wrong, also some other code would need to be changed.. it’s definitely possible just not sure there’s much gain

Ok, I totally misunderstood what you meant..thought you meant create a new entry for versioning as line 1.
So have it as part of the name, ie “German 0.0.1”... whereas now it’s just “German” and check the name against the hardcoded version numbers, Yes that would work fine.. only thing is that it would also be displayed in the GUI when selecting your language... which isn’t necessarily a bad thing anyway.

Nah, your first Tipp was right, but the second idea is interesting as well!
I'd be for entirely new language-files consisting of "blocks" anyway... 😂
Well... Maybe once upon in time.


gl4 binding attributes error with msl

When using streamout/transform feedback, the order of the vertex buffer attributes seem to violate the order of bound location.
For example,
in vec4_t pos ;
in vec4_t color ;

at program linkage those variables are coming in the opposite order but the locations are correct.
glGetActiveAttrib gives the order color then pos like so
for( active attributs )
glGetActiveAttrib

0 -> color with location 1
1 -> pos with location 0
The violation is that somehow now the color in the vertex buffer is getting bound to pos in the shader.
In the test scenario, there is only one shader used which is the transform feedback test shader.

Here it comes.
The problem is when a geometry object is used with multiple shaders, even is only one shader is uesed, where the vertex array object stores the bindings and in the second shader compiled, does not use an attribute, so the binding is invalidated and removed from the vertex array object.
There is only one solution to this. vertex array objects need to be stored per render object. A render object requires a shader and a geometry to work. So the binding of the vertex buffer attribute to the shader location should be stored there.