Datacentric

This patch provides measurement and analysis for data movement analsys of an application. It requires many changes inside HPCToolkit modules:

hpcrun: to sample using specific hardware counters
hpclink: to wrap allocation & free routines and run hpcfnbounds to collect variable bounds
hpcfnbounds: to compute variable bounds and send them to hpcrun
hpcstruct: to collect variable information (name and its bounds)
hpcprof: to collect information from hpcrun and hpcstruct, and generate datacentric information inside database
hpcviewer: to display datacentric view (independent to top-down, bottom-up and flat views)

Support modules:

lib/support-lean/datacentric_config.[ch]: datacentric configuration
used by hpcrun, hpcstruct and hpcfnbounds (to be checked)
configure.ac: add a test whether perf's data_src is supported or not.
hpcrun/Makefile.am: only include datacentric sample-source if
configure.ac detects the presence of perf's data_src.

See README file for further details.

@laksono Some basic questions about running datacentric.

How do I build the datacentric branch?
Any extra prereqs beyond building for master?
Any later revs for gcc?

Is this based on papi or libpfm?
If papi, any special config for papi?

What are the datacentric sample sources?
The README mentions datacentric, are there others?
What are the units?

Since you're creating a new <V> tag, I assume that you need
hpcprof from the same branch?

Does it require any special verison of the viewer?

@laksono Some basic questions about running datacentric.

How do I build the datacentric branch?
Any extra prereqs beyond building for master?
Any later revs for gcc?

There is no pre-requisites. The autoconf will detect if the kernel has datacentric supports or not, and hpcrun will check if the CPU has datacentric-support PMU or not.
We just do configure as usual.

Is this based on papi or libpfm?
If papi, any special config for papi?

It's based on libpfm which is the default.

What are the datacentric sample sources?
The README mentions datacentric, are there others?

Nope.

What are the units?

The unit depends on the platform. On some intels, the unit of some metrics is the latency (cycles).
Most metrics are the counts of loads/stores/L1-hit/L2-hit, etc.
On Power architecture, it's a bit tricky. We use a channel in INST_CMPL hardware counter to set MMCRA, but the unit is not completed instructions.  I am not sure what the unit is, but we are to collect the impact of a variable in memory hierarchy.

Since you're creating a new <V> tag, I assume that you need
hpcprof from the same branch?
Yes.

Does it require any special verison of the viewer?
Nope. The latest version of the viewer should work.

This repository has moved to GitLab, please continue this PR there.

The previous link was incorrect, apologies. The corrected link is here.


[DO NOT MERGE] Try to ensure we try to solve BindParam constraints left-to-right.

Builds on https://github.com/apple/swift/pull/11118, but attempts to deal with BindParam constraints differently.

@swift-ci Please smoke test

@swift-ci Please smoke test OS X platform

@swift-ci please smoke test Linux Platform

@swift-ci Please smoke test OS X platform

@rudkx Updating CI with new Xcode

I've opened a new PR for my part of this fix: https://github.com/apple/swift/pull/11629


DBDAART-4917 Add Codeowner File

What is this and why are we doing it?
I have obtained the Github jobcode and have been added to the Mathematica TAF developers group. I updated the CODEOWNERS file to be added as an official code owner.

Link to the Jira ticket for this change: https://jiraent.cms.gov/browse/DBDAART-####
https://jiraent.cms.gov/browse/DBDAART-4917

What are the security implications from this change?
NA
How did I test this?
NA
Should there be new or updated documentation for this change? (Be specific.)
NA
PR Checklist

[ ] The JIRA ticket number and a short description is in the subject line
[ ] My code follows any applicable style guides
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation

@alihashmi-wh Hi Ali, any chance you can give this PR a quick review/approval?   Thanks!


Remove the strongify/weakify macros

Eigen wouldn't compile on the next Xcode point release. They were bringing up more errors around the @weakify() and @strongify()macros. They are a nice sugar, but because of the teams behind them it's not worth us keeping them around.
I tried to make very few actual code changes. To keep it on topic.

I’m only a bit afraid that sself will be easy to miss during a review over e.g. strongSelf.

:+1:


display value of settings.errorText upon failure

the value of the errorText attribute in the settings object isn't getting displayed even when the request fails. Is this the intended behavior? We can display it by changing this line
Is display an empty string the intended behavior? If so, were should the error message be displayed?

Showing an empty string wasn't intended behavior, thanks for the fix!


Generate forms directly in the Publicodes Studio

One interesting use case of publicodes is to generate interactive forms. @revolunet has created great examples of that in https://socialgouv.github.io/demo-publicodes. Betagouv teams also use publicodes to generate these form: https://mon-entreprise.urssaf.fr/gérer/demande-mobilité and https://code.travail.gouv.fr/outils/preavis-demission
It would be great to be able to generate these kind of forms directly in the publicodes studio. To implement this feature we need to:

standardize how we define meta-data on rules to customize the input fields
have a way to see and edit the situation object in the studio

react-jsonschema-form may have an interesting approach with an optional uiSchema definition key that hold the form customisation

standardize how we define meta-data on rules to customize the input fields

I'm not sure it's needed for a first basic implementation :)


Cannot run humbug on a Symfony project

I am trying to use humbug on my Symfony project and I have this weird behavior. Humbug does not find my test suite.
Here is my humbug configuration:
{
    "chdir": "app",
    "timeout": 10,
    "source": {
        "directories": [
            "src"
	]
    },
    "logs": {
        "text": "humbuglog.txt",
        "json": "humbuglog.json"
    }
}

Here is my phpunit configuration file:
<?xml version="1.0" encoding="UTF-8"?>

<!-- http://phpunit.de/manual/current/en/appendixes.configuration.html -->
<phpunit
    backupGlobals               = "false"
    backupStaticAttributes      = "false"
    colors                      = "true"
    convertErrorsToExceptions   = "true"
    convertNoticesToExceptions  = "true"
    convertWarningsToExceptions = "true"
    processIsolation            = "false"
    stopOnFailure               = "false"
    syntaxCheck                 = "false"
    bootstrap                   = "bootstrap.php.cache" >

    <testsuites>
        <testsuite name="Test Suite">
            <directory>../src/*/*Bundle/Tests</directory>
        </testsuite>
    </testsuites>

    <filter>
        <whitelist>
            <directory>../src</directory>
            <exclude>
                <directory>../src/*/*Bundle/Resources</directory>
                <directory>../src/*/*Bundle/Tests</directory>
            </exclude>
        </whitelist>
    </filter>
</phpunit>

I can run my test suite directly from the command line or from netbeans, but it seems that there is something blocking the use of it from humbug. Here is humbug output:

 _  _            _
| || |_  _ _ __ | |__ _  _ __ _
| __ | || | '  \| '_ \ || / _` |
|_||_|\_,_|_|_|_|_.__/\_,_\__, |
                          |___/
Humbug version 1.0-dev

Humbug running test suite to generate logs and code coverage data...

    0 [>---------------------------------------------------------]  1 sec

Humbug has completed the initial test run successfully.
Tests: 0 Line Coverage: 0.00%

Humbug is analysing source files...

Mutation Testing is commencing on 91 files...
(.: killed, M: escaped, S: uncovered, E: fatal error, T: timed out)

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS |   60 (13/91)
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS |  120 (13/91)
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS |  180 (16/91)
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS |  240 (17/91)
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS |  300 (48/91)
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS |  360 (60/91)
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS |  420 (65/91)
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS |  480 (65/91)
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS |  540 (66/91)
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS |  600 (77/91)
SSSSSSSSSSSSSSSSSSSSSSS

623 mutations were generated:
       0 mutants were killed
     623 mutants were not covered by tests
       0 covered mutants were not detected
       0 fatal errors were encountered
       0 time outs were encountered

Out of 0 test covered mutations, 0% were detected.
Out of 623 total mutations, 0% were detected.
Out of 623 total mutations, 0% were covered by tests.

Remember that some mutants will inevitably be harmless (i.e. false positives).

Humbug results are being logged as JSON to: humbuglog.json
Humbug results are being logged as TEXT to: humbuglog.txt

Time: 36.42 seconds Memory: 7.25MB

And phpunit output:
PHPUnit 4.3.5 by Sebastian Bergmann.

Configuration read from C:\Work\Sources\app\phpunit.xml.dist

...............................................................  63 / 677 (  9%)
............................................................... 126 / 677 ( 18%)
............................................................... 189 / 677 ( 27%)
............................................................... 252 / 677 ( 37%)
............................................................... 315 / 677 ( 46%)
............................................................... 378 / 677 ( 55%)
............................................................... 441 / 677 ( 65%)
............................................................... 504 / 677 ( 74%)
............................................................... 567 / 677 ( 83%)
............................................................... 630 / 677 ( 93%)
...............................................

Time: 44.55 seconds, Memory: 30.25Mb

←[30;42mOK (677 tests, 1057 assertions)←[0m

Generating code coverage report in Clover XML format ... done

I am running that on W7 in git bash CLI interface.
Do you have any ideas why it is not working?

I even tried to run it in cygwin and I have the same thing

Just to cover the basics (I won't ask you to check the power cable!):
Is humbug.json located in root directory (same level as app and src)?
From what directory are you running humbug?
Any example of a public repo where this occurs (if I can locate one, should be simple to spot the pathing issue)?

So my power cable was plugged :)
So my humbug.json was in the root directory. I was running humbug in the root directory as well.
Humbug itself is located outside my root directory.
I have no public repo available and I am not authorized to share my work repo. I'll try to find one.

@aledeg Give it a shot now and see if @rollenes changes work out. I'm reopening temporarily so you can confirm if fixed.

I will test it on Monday. I let you know

@aledeg No problem - enjoy the weekend :P

So I tested it and it's even worst. Now I have this error message

 _  _            _
| || |_  _ _ __ | |__ _  _ __ _
| __ | || | '  \| '_ \ || / _` |
|_||_|\_,_|_|_|_|_.__/\_,_\__, |
                          |___/
Humbug version 1.0-dev

Humbug running test suite to generate logs and code coverage data...

    0 [>---------------------------------------------------------]  1 sec
Warning: array_map(): An error occurred while invoking the map callback in C:\Work\Sources\Contrib\humbug\src\Adapter\Locator.php on line 51

Call Stack:
    0.0000     129880   1. {main}() C:\Work\Sources\Contrib\humbug\bin\humbug:0
    0.0312    1279760   2. Symfony\Component\Console\Application->run() C:\Work\Sources\Contrib\humbug\bin\humbug:23
    0.0312    1534400   3. Symfony\Component\Console\Application->doRun() C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Application.php:126
    0.0312    1534856   4. Symfony\Component\Console\Application->doRunCommand() C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Application.php:195
    0.0312    1535064   5. Symfony\Component\Console\Command\Command->run() C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Application.php:874
    0.0312    1536800   6. Humbug\Command\Humbug->execute() C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Command\Command.php:253
    0.0468    2097544   7. Humbug\Adapter\Phpunit->getProcess() C:\Work\Sources\Contrib\humbug\src\Command\Humbug.php:108
    0.0468    2098864   8. Humbug\Adapter\Phpunit->assembleXmlConfiguration() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit.php:74
    0.0468    2125136   9. Humbug\Adapter\Phpunit\XmlConfigurationBuilder->getConfiguration() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit.php:210
    0.0468    2168432  10. Humbug\Adapter\Phpunit\XmlConfigurationBuilder->initializeConfiguration() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfigurationBuilder.php:78
    0.0624    2187240  11. Humbug\Adapter\Phpunit\XmlConfiguration->replacePathsToAbsolutePaths() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfigurationBuilder.php:130
    0.0624    2189120  12. Humbug\Adapter\Phpunit\XmlConfiguration\ReplaceWildcardVisitor->visitElement() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfiguration.php:193
    0.0624    2189216  13. Humbug\Adapter\Locator->locateDirectories() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfiguration\ReplaceWildcardVisitor.php:21
    0.0624    2189760  14. array_map() C:\Work\Sources\Contrib\humbug\src\Adapter\Locator.php:51

  [Humbug\Exception\InvalidArgumentException]
  Could not find file app/../src/Company/PermitBundle/Tests working from app

humbug [-a|--adapter="..."] [-o|--options="..."] [-c|--constraints="..."] [-t|--timeout="..."] [subcommand]

@rollenes Any ideas?

@aledeg Can you also run Humbug with -vvv as an option (should get the whole exception stack)?

Per your request, here is the full stack
 _  _            _
| || |_  _ _ __ | |__ _  _ __ _
| __ | || | '  \| '_ \ || / _` |
|_||_|\_,_|_|_|_|_.__/\_,_\__, |
                          |___/
Humbug version 1.0-dev

Humbug running test suite to generate logs and code coverage data...

    0 [>---------------------------------------------------------]  1 sec
Warning: array_map(): An error occurred while invoking the map callback in C:\Work\Sources\Contrib\humbug\src\Adapter\Locator.php on line 51

Call Stack:
    0.0000     129976   1. {main}() C:\Work\Sources\Contrib\humbug\bin\humbug:0
    0.0220    1279808   2. Symfony\Component\Console\Application->run() C:\Work\Sources\Contrib\humbug\bin\humbug:23
    0.0280    1534520   3. Symfony\Component\Console\Application->doRun() C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Application.php:126
    0.0290    1534976   4. Symfony\Component\Console\Application->doRunCommand() C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Application.php:195
    0.0290    1535184   5. Symfony\Component\Console\Command\Command->run() C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Application.php:874
    0.0300    1537600   6. Humbug\Command\Humbug->execute() C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Command\Command.php:253
    0.0480    2098368   7. Humbug\Adapter\Phpunit->getProcess() C:\Work\Sources\Contrib\humbug\src\Command\Humbug.php:108
    0.0480    2099688   8. Humbug\Adapter\Phpunit->assembleXmlConfiguration() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit.php:74
    0.0490    2125960   9. Humbug\Adapter\Phpunit\XmlConfigurationBuilder->getConfiguration() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit.php:210
    0.0510    2169256  10. Humbug\Adapter\Phpunit\XmlConfigurationBuilder->initializeConfiguration() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfigurationBuilder.php:78
    0.0530    2188064  11. Humbug\Adapter\Phpunit\XmlConfiguration->replacePathsToAbsolutePaths() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfigurationBuilder.php:130
    0.0540    2189944  12. Humbug\Adapter\Phpunit\XmlConfiguration\ReplaceWildcardVisitor->visitElement() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfiguration.php:193
    0.0540    2190040  13. Humbug\Adapter\Locator->locateDirectories() C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfiguration\ReplaceWildcardVisitor.php:21
    0.0540    2190584  14. array_map() C:\Work\Sources\Contrib\humbug\src\Adapter\Locator.php:51

  [Humbug\Exception\InvalidArgumentException]
  Could not find file app/../src/MyCompany/PermitBundle/Tests working from app

Exception trace:
 () at C:\Work\Sources\Contrib\humbug\src\Adapter\Locator.php:44
 Humbug\Adapter\Locator->locate() at n/a:n/a
 array_map() at C:\Work\Sources\Contrib\humbug\src\Adapter\Locator.php:51
 Humbug\Adapter\Locator->locateDirectories() at C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfiguration\ReplaceWildcardVisitor.php:21
 Humbug\Adapter\Phpunit\XmlConfiguration\ReplaceWildcardVisitor->visitElement() at C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfiguration.php:193
 Humbug\Adapter\Phpunit\XmlConfiguration->replacePathsToAbsolutePaths() at C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfigurationBuilder.php:130
 Humbug\Adapter\Phpunit\XmlConfigurationBuilder->initializeConfiguration() at C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit\XmlConfigurationBuilder.php:78
 Humbug\Adapter\Phpunit\XmlConfigurationBuilder->getConfiguration() at C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit.php:210
 Humbug\Adapter\Phpunit->assembleXmlConfiguration() at C:\Work\Sources\Contrib\humbug\src\Adapter\Phpunit.php:74
 Humbug\Adapter\Phpunit->getProcess() at C:\Work\Sources\Contrib\humbug\src\Command\Humbug.php:108
 Humbug\Command\Humbug->execute() at C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Command\Command.php:253
 Symfony\Component\Console\Command\Command->run() at C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Application.php:874
 Symfony\Component\Console\Application->doRunCommand() at C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Application.php:195
 Symfony\Component\Console\Application->doRun() at C:\Work\Sources\Contrib\humbug\vendor\symfony\console\Symfony\Component\Console\Application.php:126
 Symfony\Component\Console\Application->run() at C:\Work\Sources\Contrib\humbug\bin\humbug:23

humbug [-a|--adapter="..."] [-o|--options="..."] [-c|--constraints="..."] [-t|--timeout="..."] [subcommand]

@padraic I`ll try to recreate this issue.

I recreated issue. Did some regression testing in #112.
@aledeg I do not run Windows so it would be very helpfull to have feedback from you after merge #112.

@aledeg Changes merged.
We will get there...eventually ;). Thanks @rollenes for looking at this.

So I run it this morning and it is working. The only thing that is weird is that the output doesn't look like that:
242 [=======================================================] 30 secs

I have something which looks like that instead:
    0 [>---------------------------------------------------------]  1 sec
    1 [->--------------------------------------------------------] 3 secs
    2 [-->-------------------------------------------------------] 3 secs
    3 [--->------------------------------------------------------] 3 secs
    4 [---->-----------------------------------------------------] 3 secs
    5 [----->----------------------------------------------------] 3 secs
    6 [------>---------------------------------------------------] 3 secs
    7 [------->--------------------------------------------------] 4 secs
    8 [-------->-------------------------------------------------] 4 secs
    9 [--------->------------------------------------------------] 4 secs
   10 [---------->-----------------------------------------------] 4 secs
   11 [----------->----------------------------------------------] 4 secs
   12 [------------>---------------------------------------------] 4 secs
   13 [------------->--------------------------------------------] 4 secs
   14 [-------------->-------------------------------------------] 4 secs
   15 [--------------->------------------------------------------] 4 secs
   16 [---------------->-----------------------------------------] 4 secs
   17 [----------------->----------------------------------------] 4 secs
   18 [------------------>---------------------------------------] 4 secs
   19 [------------------->--------------------------------------] 4 secs
   20 [-------------------->-------------------------------------] 5 secs
   21 [--------------------->------------------------------------] 5 secs

and it goes for more than 600 lines.
Any ideas?

Make your console window wider and try again to see if that fixes it. I assume it's related to the following issue: https://github.com/symfony/symfony/issues/13019

That's not the case since my window is maximized. Maybe it is a problem with cygwin

I did the same test on git bash and I have the same problem. And I can see the progress bar completely, so it is not related to the bug you mentioned.

I probably can't fix that outright if overwriting doesn't work, but I make it more palatable. I've added a redraw frequency setting for undecorated consoles. You won't get 600 lines - should be around 10 now at a redraw of 60.

Nice! That's way better than having over 600 lines :+1:

I reproduced this issue by zooming my bash console on Linux. So it looks
like it is a Progress Bar issue.
2015-03-03 20:27 GMT+01:00 Alexis Degrugillier<EMAIL_ADDRESS>
I did the same test on git bash and I have the same problem. And I can see
the progress bar completely, so it is not related to the bug you mentioned.
—
Reply to this email directly or view it on GitHub
https://github.com/padraic/humbug/issues/110#issuecomment-77015839.

That's what mentioned @padraic. In my use case, the windows was maximized so it is not linked to that problem. I guess that my consoles do not support redraw.
Anyway it is not a big deal.
Thank to both of you

@rollenes Yeah, that's one cause. The other is certain consoles not supporting the overwrite decoration, in which case all you can do is either remove the progress bar, or print it on a newline automatically based on a redraw calc. Should be good now though perhaps a non-progressbar alternative eventually might be a good idea for these cases.

I think that what you've done is sufficient for the redraw. The only thing I can think of is having a nicer number than 60 like 100 for instance.


Add _rollbackSlider

I need initialization slider. So I added this function.
I think some people really need this function.

Thank you for the PR!

Please update Progress.html


[SAM] Hangs for the entire lambda timeout, then responds

Problem
Hi, I'm using AWS SAM and I'm running locally with sam local start-api. However, when I add the dd lambda extension layer, it causes my handler to run for the full timeout before responding normally. From my local logs, I can see that my handler is returning a value almost immediately, so the delay is from the dd lambda wrapper. This makes it very difficult to work locally, which is important to me. My guess is maybe it's failing to authenticate with datadog and timing out? But, it's not emitting any auth errors. Is there any way to get more information about why it's hanging?
Sequence of events

I start my local API using sam build, then sam local start-api.
Send request using postman
My lambda runs and returns a response almost immediately. There are a few logs from datadog:

Lambda function 'MyFunction' is already running
START RequestId: 21d0304a-779d-4b7a-b895-5b1142303bff Version: $LATEST
2024/08/23 16:27:05 {"status":"error","message":"datadog: Couldn't convert X-Ray trace context: Couldn't read trace id from X-Ray: invalid x-ray trace id; expected 3 components in id"}
2024/08/23 16:27:05 Datadog Tracer v1.65.1 INFO: DATADOG TRACER CONFIGURATION { <long configuration json> }
2024/08/23 16:27:05 MyFunctionHandler: returning response

The lambda runs for the full 30 second timeout, then it logs the following and sends the response back to postman.

I suspect that the reason is because the AWS Lambda Runtime Interface Emulator is being used by SAM.
Unfortunately AWS does not emulate the telemetry API in the runtime interface emulator.
The telemetry API is how Lambda Extensions communicate with the AWS Lambda Runtime, and we require it to tell us important things like:

logs from your function
runtime metrics
and most crucially
runtime events, like when your Lambda function is finished processing.

Today we can't support the emulator because of this limitation. Instead, we recommend using a conditional variable to skip the Lambda Extension and Lambda Instrumentation when emulating locally.
This has been an issue for a long time, so we'd appreciate if you leave a comment asking for this feature from AWS and mention it to your TAM.
Thanks!
AJ

Thanks for the info! I've commented on their issue.
Since this is a known issue where we know DataDog isn't compatible with SAM local, I would request a documentation update on the DD side for the following:

Warning message that this doesn't work.
Workaround code to conditionally turn on DD only when not running locally.

Thanks @distinctdan - I've learned that we document the DD_LOCAL_TESTING env var here, but I'm not sure exactly the full breadth of support and I don't expect Datadog's instrumentation to work locally due to the disparities between Lambda and other local testing options.
It may prevent the extension from hanging in your case though. Either way, our recommendation is to disable Datadog in a local emulation environment.
Thanks!

Thanks for the info, but unfortunately it looks like that flag doesn't change the behavior for me. At the very least, I would expect the DD lambda to emit some kind of log saying it can't connect instead of silently failing. I know it's not y'all's fault that this doesn't work, but I've spent several hours tracking this down, and some documentation or error logs on the datadog side would have made this a lot easier.

Hi @distinctdan, thanks for the note.
The connection from the extension to the telemetry API can be established, the issue is that no runtime events are passed (only logs). So for the extension, there's no way to know that we'll never receive those events.
I will ask our documentation team to more clearly describe our recommendation to not use Datadog's instrumentation locally at this time.
Thanks!

I see, yeah that's pretty unfortunate. Ok, thanks for the help!

Hi @distinctdan - if you try out our new next-generation Lambda extension locally, you can specify a short flush interval via DD_SERVERLESS_FLUSH_STRATEGY=periodically,1 which should no longer wait for any events. I don't expect the data to be correct or coherent in Datadog, but it should at least allow the function to run: https://github.com/DataDog/datadog-lambda-extension/pull/377
I hope this helps!


⚠ AGEG website (redirect) has degraded performance

In 05cf5a6, AGEG website (redirect) (https://ageg.ca/) experienced degraded performance:

HTTP code: 200
Response time: 2043 ms

Resolved: AGEG website (redirect) performance has improved in e21b947.


Enhanced Readme File with improvements

Related Issuse or bug

Info about Issue or bug

Fixes: #46 [issue number that will be closed through this PR]
Describe the changes you've made
Added GSSOC Tag as required Below DWOC Tag and some minor improvements.
Type of change
Please delete options that are not relevant.

[x] This change requires a documentation update

How Has This Been Tested?
NA
Describe if there is any unusual behaviour of your code(Write NA if there isn't)
NA
Checklist:

[x] My code follows the style guidelines of this project.
[x] I have performed a self-review of my own code.
[x] I have made corresponding changes to the documentation.
[x] My changes generate no new warnings.

Hey @rahulsain, can you get the logo of GSSOC with a transparent BG and instead of having both the logos together, can you find a better way of placing them?


Tracking data related to new service onboarding

We have a request from Azure SDK leadership to provide data for new services onboarding with the Azure SDK team.  Today all of our Azure Devops data is for products that we are tracking for APEX launch readiness.  There was a field added to the ADO work items in 2022 to add name and service tree ID for the associated service and the lifecycle of the associated service.

Determine the best way to track new services onboarding going forward.
To get this data now, I pulled all of the APEX product data from Azure Devops and manually sorted to figure out an estimate of number of services onboarding over time - https://microsoft-my.sharepoint.com/:x:/p/ladonnaquinn/EQg6yA-U0x9Jox4a_qQ34J4BpbRfiy_DsRoxSz6YCiMfAw?e=8d3TkE.  This effort was time consuming, and I had to estimate the onboard date for the older data (because anything before 2022 was migrated to our project by Carl). It might be good to generate a work item or something for each service, then have the products be children of the service.  This way we can keep service specific data with the service record and APEX related data in the work item for the products. @maririos We should consider how we want to do this as part of the redesign of ADO release project that you were investigating.

This has been covered as part of https://github.com/Azure/azure-sdk-tools/issues/5698


Add usage instructions to the readme

I had to do various bits of Googling to be able to use this generator; thought I'd contribute by adding some basic instructions and avoiding pitfalls (e.g unsupported node version for the Yeoman version)

Done those changes

Thanks!


Transgender Configurations Pages Alignment

Alignment for configurations page (both in the body and at the first)
making titles bold and texts bold
making the first page and body config page identical

This task is mostly done however there are some points which need to be fixed before closing this issue:

The first config page in FR is not aligned
The text of terms of use is bold which should be unbold

Its fixed and ready to be deployed in the next code push


Bug when image is not accessible on Flutter Web

Due to CORS issues when running on Flutter Web it may block at some point.
This is not a problem in general if you use a cors-proxy.   But there is on bug at least in the code:
In the Util.dart
Future<Size> _getImageSize(String url) {
  final stream = Image.network(url).image.resolve(ImageConfiguration.empty);
  final completer = Completer<Size>();

  void onError(Object e, StackTrace? __) {
    print(e);
  }

  void listener(ImageInfo info, bool _) {
    if (!completer.isCompleted) {
      completer.complete(
        Size(
          height: info.image.height.toDouble(),
          width: info.image.width.toDouble(),
        ),
      );
      stream.removeListener(ImageStreamListener(listener, onError: onError));
    }
  }

  stream.addListener(ImageStreamListener(listener, onError: onError));
  return completer.future;
}

The problem is that the completer never complete is it encounter a CORS problem for fetching the image.
At least you can change the onError to:
void onError(Object e, StackTrace? s) {
    completer.completeError(e, s);
  }

Released in v2.2.2. Thanks for the PR!


9533 query rewriter

Qualifies table names in queries when creating a map from a shared dataset.
Also does a refactor trying to unify some of the query rewriting code. It is actually not needed with the latest version of this patch (I first thought that I could reuse the same query rewriting than in the importer for this, but qualifying != schema rewriting). I still kept it as I think it is a nice addition.
Fixes #9533

Please CR @juanignaciosl

LGTM 👍  Feel free to ignore the only actual comment. :shipit: !


[BUG] VOE ERROR: 'NoneType' object has no attribute 'group' & Could not find cache url for VOE

Describe the bug:
I can not download anything using provider VOE (but Streamtape works)
Tested both Aniworld and SerienStream
ERRORS:

'NoneType' object has no attribute 'group'
Could not find cache url for VOE

Steps to Reproduce the bug:
Please select a download type:
 > Anime
   TV-show
   Quit

Please select the download mode:
 > Seasons
   Movies
   Quit

Please select a language:
 > German
   English
   GerSub
   Quit

Type in the name
example URL: https://aniworld.to/anime/stream/made-in-abyss/staffel-1
[made-in-abyss]
 > made-in-abyss

Please select a season:
 > All
   Custom
   Quit

Please select a provider:
 > VOE
   Streamtape
   Vidoza
   Quit

Expected behavior:
Downloads like when using Streamtape
Screenshots:
none
Logs:
2024-07-08 17:59:28 - DEBUG - src.constants - cli argument detected on position:1 with value:anime
2024-07-08 17:59:28 - DEBUG - src.constants - cli argument detected on position:2 with value:made-in-abyss
2024-07-08 17:59:28 - DEBUG - src.constants - cli argument detected on position:3 with value:Deutsch
2024-07-08 17:59:28 - DEBUG - src.constants - cli argument detected on position:4 with value:series
2024-07-08 17:59:28 - DEBUG - src.constants - cli argument detected on position:5 with value:0
2024-07-08 17:59:28 - DEBUG - src.constants - cli argument detected on position:6 with value:VOE
2024-07-08 17:59:28 - INFO - src.start_app - ------------- AnimeSerienScraper v01-10-00 started ------------
2024-07-08 17:59:28 - DEBUG - src.start_app - We have Read Permission
2024-07-08 17:59:28 - DEBUG - src.start_app - We have Write Permission
2024-07-08 17:59:28 - INFO - src.start_app - No Season override detected.
2024-07-08 17:59:28 - DEBUG - src.logic.collect_all_seasons_and_episodes - Entered get_season.
2024-07-08 17:59:28 - DEBUG - src.logic.collect_all_seasons_and_episodes - Site URL is: https://aniworld.to/anime/stream/made-in-abyss/
2024-07-08 17:59:29 - DEBUG - src.logic.collect_all_seasons_and_episodes - Now leaving Function get_season
2024-07-08 17:59:29 - INFO - src.start_app - We have this many seasons: 2
2024-07-08 17:59:31 - DEBUG - src.logic.collect_all_seasons_and_episodes - Entered get_episodes
2024-07-08 17:59:32 - DEBUG - src.logic.collect_all_seasons_and_episodes - Now leaving Function get_episodes
2024-07-08 17:59:32 - INFO - src.start_app - Season 1 has 13 Episodes.
2024-07-08 17:59:32 - INFO - src.start_app - File name will be: /media/usr/drive/anime/made-in-abyss_(2013)/Season 01/made-in-abyss - s01e01 - Deutsch.mp4
2024-07-08 17:59:32 - DEBUG - src.logic.downloader - File not downloaded. Downloading: /media/usr/drive/anime/made-in-abyss_(2013)/Season 01/made-in-abyss - s01e01 - Deutsch.mp4
2024-07-08 17:59:32 - DEBUG - src.logic.language - Language mapping: {'German': '1', 'Deutsch': '1', 'mit Untertitel Deutsch': '3', 'Ger-Sub': '3', 'Deutscher Untertitel': '3'}
2024-07-08 17:59:32 - DEBUG - src.logic.language - Given language: Deutsch
2024-07-08 17:59:32 - DEBUG - src.logic.search_for_links - Link to redirect is: https://aniworld.to/redirect/1798416
2024-07-08 17:59:32 - DEBUG - src.start_app - Entered DDOS var check and starting new downloader.
2024-07-08 17:59:32 - DEBUG - src.logic.search_for_links - Enterd VOE to cache
2024-07-08 17:59:33 - ERROR - src.logic.search_for_links - ERROR: 'NoneType' object has no attribute 'group'
2024-07-08 17:59:33 - INFO - src.logic.search_for_links - Trying again...
2024-07-08 17:59:33 - DEBUG - src.logic.search_for_links - Enterd VOE to cache
2024-07-08 17:59:34 - ERROR - src.logic.search_for_links - ERROR: 'NoneType' object has no attribute 'group'
2024-07-08 17:59:34 - INFO - src.logic.search_for_links - Trying again...
2024-07-08 17:59:34 - DEBUG - src.logic.search_for_links - Enterd VOE to cache
2024-07-08 17:59:34 - ERROR - src.logic.search_for_links - ERROR: 'NoneType' object has no attribute 'group'
2024-07-08 17:59:34 - INFO - src.logic.search_for_links - Trying again...
2024-07-08 17:59:34 - DEBUG - src.logic.search_for_links - Enterd VOE to cache
2024-07-08 17:59:35 - ERROR - src.logic.search_for_links - ERROR: 'NoneType' object has no attribute 'group'
2024-07-08 17:59:35 - INFO - src.logic.search_for_links - Trying again...
2024-07-08 17:59:35 - DEBUG - src.logic.search_for_links - Enterd VOE to cache
2024-07-08 17:59:36 - ERROR - src.logic.search_for_links - ERROR: 'NoneType' object has no attribute 'group'
2024-07-08 17:59:36 - INFO - src.logic.search_for_links - Trying again...
2024-07-08 17:59:36 - DEBUG - src.logic.search_for_links - Enterd VOE to cache
2024-07-08 17:59:37 - ERROR - src.logic.search_for_links - ERROR: 'NoneType' object has no attribute 'group'
2024-07-08 17:59:37 - INFO - src.logic.search_for_links - Trying again...
2024-07-08 17:59:37 - ERROR - src.logic.search_for_links - Could not find cache url for VOE.
2024-07-08 17:59:37 - ERROR - src.start_app - Could not find cache url for VOE on 1, 1.
2024-07-08 17:59:37 - INFO - src.start_app - File name will be: /media/usr/drive/anime/made-in-abyss_(2013)/Season 01/made-in-abyss - s01e02 - Deutsch.mp4
2024-07-08 17:59:37 - DEBUG - src.logic.downloader - File not downloaded. Downloading: /media/usr/drive/anime/made-in-abyss_(2013)/Season 01/made-in-abyss - s01e02 - Deutsch.mp4
2024-07-08 17:59:37 - DEBUG - src.logic.language - Language mapping: {'German': '1', 'Deutsch': '1', 'mit Untertitel Deutsch': '3', 'Ger-Sub': '3', 'Deutscher Untertitel': '3'}
2024-07-08 17:59:37 - DEBUG - src.logic.language - Given language: Deutsch
2024-07-08 17:59:37 - DEBUG - src.logic.search_for_links - Link to redirect is: https://aniworld.to/redirect/1798412
2024-07-08 17:59:37 - DEBUG - src.start_app - Entered DDOS var check and starting new downloader.
2024-07-08 17:59:37 - DEBUG - src.logic.search_for_links - Enterd VOE to cache
2024-07-08 17:59:38 - ERROR - src.logic.search_for_links - ERROR: 'NoneType' object has no attribute 'group'
2024-07-08 17:59:38 - INFO - src.logic.search_for_links - Trying again...
2024-07-08 17:59:38 - ERROR - src.logic.search_for_links - Could not find cache url for VOE.
2024-07-08 17:59:38 - ERROR - src.start_app - Could not find cache url for VOE on 1, 2.
2024-07-08 17:59:38 - INFO - src.start_app - File name will be: /media/usr/drive/anime/made-in-abyss_(2013)/Season 01/made-in-abyss - s01e03 - Deutsch.mp4
...

Additional Info:

Release: V-2.03
All packages from requirements.txt installed
Debian 12 with Python Virtual Environment
ffmpeg installed via apt
There is no captcha request

@white-chestnut Probably VOE updated theyr stuff again to make it harder to scrape. Its the 6th time if im not wrong where they changed stuff like regex etc.
Ill look into it

@white-chestnut Fixed. Please try again with the latest commit and if it works for you as well ill make a new release.

Thank you very much, now it works like a charm.

BTW: Do you take donations?


Feature/add leaky relu models

Added code for issue
https://github.com/Megvii-BaseDetection/YOLOX/issues/742
I can also provide pretrained models for yolox s/m/l/x if needed.

Thx for your contribution which makes it easier to define custom models.
But we currently have no plan to add official lrelu models. So could you remove all the exp files in default and only preserve the change in yolox_base.py? The default exp file of nano should also be changed.

@ruinmessi
I've removed the custom configurations & added support to nano models.


[BUG?] chart doesn't animate on first load?

Expected and Current Behavior
Hi - my chart's animations aren't appearing on first load. It works fine on second, third, etc. though.
Steps to Reproduce (for bugs)
Fiddle: https://jsfiddle.net/mjceb1xk/6/
as you can see, on first click of "generate report", the pie chart just appears. If you click again, the animations appear.
Any suggestions?

@rhea-s this is likely because the chart has no size before it is shown the first time. One idea here could be to set the chart to responsive: false and give it a fixed size. That might get the animation to work

It animates fine... you are just fading in and missing the animation. You should read and understand jQuery's API, timing and asynchronous events.
Here I've explicitly set the fade-in duration and set/update the chart halfway through:
https://jsfiddle.net/90x1f2bq/

Please ask questions on Satckoverflow: https://stackoverflow.com/questions/tagged/chart.js

Don't use defer attribute to your chart script

In Donut Chart  from"react-google-charts" onloading animation  does not working


Use custom VCS in branch extension

My company uses perforce with a custom wrapper to manage branches. Is there a way I can hook into the branch extension to call a custom vim function to get the VCS data or will I have to implement my own extension?

You would need to change some things in the branch extensions. Check branch.vim, add perforce to the s:vcs_config dictionary and implement a new s:update_perf_branch() function. Look at the similar s:update_hg_branch() function. Implemention should be fairly straight forward.
Also it could be possible, that vcscommand works out of the box with perforce, don't know.


Listen for modified comments

Refs https://developer.github.com/changes/2016-04-18-new-webhook-actions-are-live/

Editing an issue or pull request's body
Editing an issue comment, pull request comment

Refs https://developer.github.com/changes/2016-04-18-new-webhook-actions-are-live/

Editing an issue or pull request's body
Editing an issue comment, pull request comment

#ffffff


drivers: sensor: st: Fix uninitialized variable in lsm6dsv16x

Fix uninitialized ret variables scanned by Coverity.
from:
https://github.com/zephyrproject-rtos/zephyr/issues/81956

Thanks for the fix. Could you please mention the sensor in the commit message? Something like this:
drivers: sensor: st: Fix uninitialized variable in lsm6dsv16x

Fix uninitialized ret variables scanned by Coverity.

Signed-off-by: James Roy<EMAIL_ADDRESS>

And in the commit message add:
Fix #81956

The hit is actually on a different line alltogether, or ?
Is this not where the issue is?
https://github.com/zephyrproject-rtos/zephyr/blob/b1def7145fd158e7cec50761fece73b1d4835a2e/drivers/sensor/st/lsm6dsv16x/lsm6dsv16x_trigger.c#L50
The solution most probably is as follows, or? lsm6dsv16x_pin_int_route_t val = {};

Good catch! I'll change to it.

@rruuaanng can you also address this issue? #82068 (comment)

I've change it. Please to see my commit message

@rruuaanng can you also address this issue? #82068 (comment)

I've change it. Please to see my commit message

Actually I requested to add also following line:
Fix #81956

And in the commit message add:
Fix #81956

@avisconti According to the most recent Zephyr documentation, this should no longer be done:

Do not include GitHub references in the commit message directly, as it can lose meaning in case the repository is forked, for example. Instead, if the change addresses a specific GitHub issue, include in the Pull Request message a line of the form:

And in the commit message add:
Fix #81956

@avisconti According to the most recent Zephyr documentation, this should no longer be done:

I see. Sorry for the noise.


Avoid caching status of files not matching filename pattern

This is not a bug and a config entry error.


helm install : remove unused  "broker.globalnet"

What happened:
docs says: If your clusters have overlapping IPs (Cluster/Service CIDRs),   please set:
        --set broker.globalnet="${GLOBALNET}" \
        --set submariner.globalCidr="${GLOBAL_CIDR}" \

But I noticed there is no template file that uses this configurations. Is the typo or bug here?
What you expected to happen:
remove broker.globalnet in docs and values.yaml or use it in template files.
How to reproduce it (as minimally and precisely as possible):
Anything else we need to know?:
Environment:

Diagnose information (use subctl diagnose all):
Gather information (use subctl gather):
Cloud provider or hardware configuration:
Install tools:
Others:

I think this is necessary for Globalnet RBAC. It's used here:
https://github.com/submariner-io/submariner-charts/blob/devel/submariner-operator/templates/rbac.yaml#L293
Global CIDR is used here:
https://github.com/submariner-io/submariner-charts/blob/devel/submariner-k8s-broker/crds/crd.yaml#L42
Feel free to re-open if that's wrong!


Cannot read property 'filter' of undefined

Eth-Hot-Wallet
Please direct redux-saga related questions to stack overflow:
http://stackoverflow.com/questions/tagged/redux-saga
#10

[ ] Bug
[ ] Feature

Description
The check balance button returns an error "Cannot read property 'filter' of undefined" after linking custom token.
(Add images if possible)
Steps to reproduce
(Add link to a demo on https://jsfiddle.net or similar if possible)
Versions

ETH-Hot-Wallet (see package.json):
Node/NPM:
Browser:
10

Hi kelvinBlockchainTM,
Does your token appears on Coinmarketcap? If so, on what # ?
Currently the wallet gets the first 100 coins to reduce bandwidth (full price dump is over 1M).

I am running my token locally first before on a rinkeby testnet before listing it on coinmarket.

Where does this error appear? Does it prevent the app from loading?
To be able to help I need to see the changes.
Could you publish the changes to a fork?
On Thu, Mar 8, 2018 at 9:07 AM, Kelvin Ndereba<EMAIL_ADDRESS>wrote:

I am running my token locally first before on a rinkeby testnet before listing it on coinmarket.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.
{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/PaulLaux/eth-hot-wallet","title":"PaulLaux/eth-hot-wallet","subtitle":"GitHub repository","main_image_url":"https://cloud.githubusercontent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png","avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in GitHub","url":"https://github.com/PaulLaux/eth-hot-wallet"}},"updates":{"snippets":[{"icon":"PERSON","message":"@kelvinBlockchainTM in #15: I am running my token locally first before on a rinkeby testnet before listing it on coinmarket."}],"action":{"name":"View Issue","url":"https://github.com/PaulLaux/eth-hot-wallet/issues/15#issuecomment-371399636"}}}

I have fixed it thanks. Seems the problem was with the abi and token contract address.

I am trying to learn some concepts of your code but this error keeps coming up "genKeystore error - TypeError: ks.keyFromPassword is not a function"

What changes did you introduce? Can you publish it?

OK. Sure.
On Thu, Mar 15, 2018 at 12:46 PM, Paul Laux<EMAIL_ADDRESS>wrote:

What changes did you introduce? Can you publish it?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/PaulLaux/eth-hot-wallet/issues/15#issuecomment-373259643,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AgempXk26fPiYneNhu8y1Q81P60UlKfnks5tefIwgaJpZM4SiMzq
.

--
https://ms-my.facebook.com/blockchaintmhub/
https://www.linkedin.com/company/blockchaintmhub
https://www.instagram.com/blockchaintmhub/
KELVIN NDEREBA NGENDO
BLOCKCHAIN DEVELOPER
BTM Blockchain Technology (M) Sdn Bhd
Wisma Shell Building, 2nd Floor, Left Wing 3450,
Jalan Teknokrat 3, 63000 Cyberjaya, Selangor,  Malaysia
M:   +6013- 981 6191 <+60%2019-506%202665>
E<EMAIL_ADDRESS><EMAIL_ADDRESS>W:   blockchaintmhub https://blockchaintmhub.io/.io

Kindly Take  a look
https://github.com/kelvinBlockchainTM/ODIN-API/tree/test
On Thu, Mar 15, 2018 at 12:48 PM, Kelvin Ndereba<EMAIL_ADDRESS>wrote:

OK. Sure.
On Thu, Mar 15, 2018 at 12:46 PM, Paul Laux<EMAIL_ADDRESS>wrote:

What changes did you introduce? Can you publish it?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/PaulLaux/eth-hot-wallet/issues/15#issuecomment-373259643,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AgempXk26fPiYneNhu8y1Q81P60UlKfnks5tefIwgaJpZM4SiMzq
.

--
https://ms-my.facebook.com/blockchaintmhub/
https://www.linkedin.com/company/blockchaintmhub
https://www.instagram.com/blockchaintmhub/
KELVIN NDEREBA NGENDO
BLOCKCHAIN DEVELOPER
BTM Blockchain Technology (M) Sdn Bhd
Wisma Shell Building, 2nd Floor, Left Wing 3450,
Jalan Teknokrat 3, 63000 Cyberjaya, Selangor,  Malaysia
M:   +6013- 981 6191 <+60%2019-506%202665>
E<EMAIL_ADDRESS><EMAIL_ADDRESS>W:   blockchaintmhub https://blockchaintmhub.io/.io

--
https://ms-my.facebook.com/blockchaintmhub/
https://www.linkedin.com/company/blockchaintmhub
https://www.instagram.com/blockchaintmhub/
KELVIN NDEREBA NGENDO
BLOCKCHAIN DEVELOPER
BTM Blockchain Technology (M) Sdn Bhd
Wisma Shell Building, 2nd Floor, Left Wing 3450,
Jalan Teknokrat 3, 63000 Cyberjaya, Selangor,  Malaysia
M:   +6013- 981 6191 <+60%2019-506%202665>
E<EMAIL_ADDRESS><EMAIL_ADDRESS>W:   blockchaintmhub https://blockchaintmhub.io/.io

This is an error coming from saga.js in app/containers/homepage/saga.js
Somewhere in the function genKeystore()
Add prints to console from this function to see why is ks not defined.
If you can't resolve let me know and I'll check your code on the following days.

On Mar 15, 2018, at 7:29 AM, Kelvin Ndereba<EMAIL_ADDRESS>wrote:
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

This is an error coming from saga.js in app/containers/homepage/saga.js
Somewhere in the function genKeystore()
Add prints to console from this function to see why is ks not defined.
If you can't resolve let me know and I'll check your code on the following days.

We are working on enhancing your product and using it in our app , so we need to create API endpoints based on your app. We need your help in finding out how to achieve it.
Reach me on<EMAIL_ADDRESS>


Auto-generate TLS certificates on requester node boot

### Tasks
- [ ] https://github.com/bacalhau-project/expanso-planning/issues/551
- [ ] https://github.com/bacalhau-project/bacalhau/issues/3830
- [ ] https://github.com/bacalhau-project/bacalhau/issues/3829
- [ ] https://github.com/bacalhau-project/bacalhau/issues/3828

@frrist what are your thoughts on this? and if we are not moving forward with this, is there any code cleanup to do?

The theme here seems to be "almost secure by default" which I'd argue is worse than insecure by default.

Wearing my developer hat #3830 seems like a bad idea, I rather work with HTTP when developing.
#3829 + #3828 also seem undesirable

I would be in favor of closing this and providing our users with documentation that describes best practices for securing a cluster.
I am not sure what PR closed https://github.com/bacalhau-project/expanso-planning/issues/551 but I think we will want some type of default key generation for securing communication over NATS.
My general feedback would be to close this issue as "Not Planned"


How about some examples

This is the major topic about text types and there are no examples at all. And how about a list of properties and methods with links so this topic can become the root topic for Text types in AL Code. Seems like this should be a given, but unfortunately, NAV has always been pretty sparse in the documentation area.
Thanks

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 27336339-fc8a-6061-4ccc-d6b10aab5286
Version Independent ID: cb4ce80d-4387-f081-6f2e-81de3874249b
Content: Text Data Type - Business Central
Content Source: dev-itpro/developer/methods-auto/text/text-data-type.md
Service: dynamics365-business-central
GitHub Login: @SusanneWindfeldPedersen
Microsoft Alias: solsen

An example of what I was expecting is the topic for the TextBuilder Class, which is found at TextBuilder Class. Thanks...

Thanks for the feedback. There is currently a bug in our auto-generation tooling that doesn't generate the list for this data type like it does for the rest of the data types. We have a bug on this and once it's fixed, we'll refresh the article. Thanks.


8x or 9x enhancing

Hello guys!
I have quick question which is, is it possible to finetune or train model with more than 4x enhancing for example 8x or 9x?
thank you in advance for your time.

Yes, it is possible to train a model at x8, x9, etc. resolutions. The only issue is that there are no pre-trained models available at those resolutions, so you will have to do it without one, meaning starting from scratch.


[HUDI-6466] Fix spark insert overwrite partitioned table with dynamic partition

Change Logs
When upgrade hudi from 0.12.2->0.13.1, I found spark's capcity of insert overwrite partitioned table with dynamic partition lost,
see https://github.com/apache/hudi/issues/8283#issuecomment-1482745990:
It will cause serious data problems if upgrade to 0.13.1, user will delete all data by mistake
As https://github.com/apache/hudi/pull/7365#issuecomment-1338371540 mentioned,
insert_overwrite_table will override entire table. while insert_overwrite_partition will overwrite only matching partitions.
Now we can only use static partition syntax to realize insert_overwrite_partition semantics.
Impact

Keep insert overwrite semantics  to be forward compatible(recover dynamic partition capcity)
Realize insert_overwrite_table semantics  with partitioned table as https://github.com/apache/hudi/pull/7365#issue-1472566386 mentioned using a config(set hoodie.datasource.write.operation = insert_overwrite_table)
Use append mode to not delete whole table data as https://github.com/apache/hudi/pull/8076#discussion_r1127283648 mentioned

Risk level (write none, low medium or high below)
Media
Documentation Update
N/A
Contributor's checklist

[ ] Read through contributor's guide
[ ] Change Logs and Impact were stated clearly
[ ] Adequate tests were added if applicable
[ ] CI passed

Seems a huge behavior change, may not have time for the fix for release 0.14.0, cc @boneanxs can you help for the review here?

https://github.com/apache/hudi/blob/5d196fe61757987af29b38e1b5cf38d7ca001924/hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala#L879
Modify of this piece of code cause many test failing dure to the delete old base path logic, so just revert it and handle it in another pr

rebase master to fix pipeline

@hudi-bot run azure

@flashJd I noticed this issue before. Yes, this is a behavior change for INSERT_OVERWRITE without partition columns after #7365, but I think it's the right modification? if users don't specify partition columns, we'll consider it wants to overwrite all table?
Spark sql also does the same way. i.e. insert overwrite table_name values( #specify partition values) will overwrite whole table.

Capcity of insert overwrite partitioned table with dynamic partition lost， we can only use the  grammer insert overwrite hudi_cow_pt_tbl partition(dt = '2021-12-09', hh='12') select 13, 'a13', 1100 now.
Insert overwrite semantics not  forward compatible

As we need the capacity to insert overwrite the whole partitioned table, why not use the config to enable it and make semantics forward compatible, meanwhile not lose the dynamic partition capacity

You can still use dynamic partition, in this way:
insert overwrite hudi_cow_pt_tbl partition(dt, hh) select 13, 'a13', 1100,  '2021-12-09', '12'

the main point is that do we consider insert overwrite hudi_cow_pt_tbl select 13, 'a13', 1100,  '2021-12-09', '12' is a dynamic partition writing? I think @leesf 's view makes sense,  https://github.com/apache/hudi/pull/7365#issuecomment-1343707001

@nsivabalan hi, here are my two cents: insert overwrite xxx values(xx,xxx) has very clear semantics, it means overwrite the entire table, insert overwrite xx partition(xx) values(xx,xxx) means insert overwrite partitions, but hudi handles overwrite partitions for overwrite table, which is a definite bug and i do not think we need to introduce a new operation for it.

Also, this change can also keep the consistent behavior with spark sql, insert overwrite hudi_cow_pt_tbl select 13, 'a13', 1100,  '2021-12-09', '12' will overwrite the whole table.

I'm confused why insert overwrite hudi_cow_pt_tbl select 13, 'a13', 1100,  '2021-12-09', '12' is a not dynamic partition writing?
the semantics should can be controled by config.
we shoule clarify the conception static partition and dymanic partition
1)https://iceberg.apache.org/docs/latest/spark-writes/#insert-overwrite
iceberg dynamic and static partiton overwrite semantics
2)https://docs.databricks.com/delta/selective-overwrite.html#language-sql
delta lake dynamic partiton overwrite semantics
3)1)https://hudi.apache.org/cn/docs/quick-start-guide/#insert-overwrite
-- insert overwrite partitioned table with dynamic partition
insert overwrite table hudi_cow_pt_tbl select 10, 'a10', 1100, '2021-12-09', '10';
-- insert overwrite partitioned table with static partition
insert overwrite hudi_cow_pt_tbl partition(dt = '2021-12-09', hh='12') select 13, 'a13', 1100;
@nsivabalan @yihua @XuQianJin-Stars @KnightChess

How about follow the spark behavior? We should respect the spark configure: spark.sql.sources.partitionOverwriteMode, if it's Static, overwrite the whole table, otherwise if dynamic, overwrite the changed partitions.
It appeals this is also how iceberg works.

How about follow the spark behavior? We should respect the spark configure: spark.sql.sources.partitionOverwriteMode, if it's Static, overwrite the whole table, otherwise if dynamic, overwrite the changed partitions.
It appeals this is also how iceberg works.

Agreed, I will check the logic to respect the spark configure

Inside us, in order to compatible the user's habit of using hive, we use hive.exec.dynamic.partition.mode to be compatible with it.
In spark, this behavior will be different in diffrent datasource. For example, if write to hive table, spark.sql.sources.partitionOverwriteMode is not effective, in InsertIntoHiveTable, it only effect by hive.exec.dynamic.xxx, which has it's own controller action.
So, if we want to use spark behavior here, I think the behavior should belong to the hudi itself, not engine. and all engines are implemented in this way by use its own parameters. what about you think?

Do you mean use hudi's own parameter to control the dynamic partition behavior

Do you mean use hudi's own parameter to control the dynamic partition behavior

Wondering how Iceberg handles the syncing of different engine behaviors.

Do you mean use hudi's own parameter to control the dynamic partition behavior

yeah, but from the engine, hudi is just a format, and the engine control deletion behavior is also reasonable.

Wondering how Iceberg handles the syncing of different engine behaviors.

I only know that spark is controlled by the computing  engine

How about follow the spark behavior? We should respect the spark configure: spark.sql.sources.partitionOverwriteMode, if it's Static, overwrite the whole table, otherwise if dynamic, overwrite the changed partitions.
It appeals this is also how iceberg works.

Agreed, I will check the logic to respect the spark configure

@boneanxs @KnightChess @danny0405

I try to respect the spark configure spark.sql.sources.partitionOverwriteMode, but found it's supported in datasource v2 as HoodieInternalV2Table only support V1_BATCH_WRITE TableCapability thus can't extend  interface SupportsDynamicOverwrite
For iceberg, I found it repsect the spark config as implement the interface SupportsDynamicOverwrite, but it  also set
it's own configure to control the static/dynamic overwrite semantics,
https://github.com/apache/iceberg/blob/1f1ec4be478feae79b04bcea3e9a8556d8076054/spark/v3.4/spark/src/main/java/org/apache/iceberg/spark/SparkWriteConf.java#L106
As the v2 BATCH_WRITE not supported now, we can first use hooide config hoodie.datasource.write.operation = insert_overwrite_table/insert_overwrite to implement the static/dynamic overwrite semantics, then respect spark configure when v2 write support.
what about you think?

I looked into how iceberg and delta handle this,
Iceberg
like @flashJd mentioned before:

Write option overwrite-mode, like HUDI's HoodieOptionConfig
Controlled by spark.sql.sources.partitionOverwriteMode, by implementing interface SupportsDynamicOverwrite, spark inside will handles this.

Delta
Roughly the same with Iceberg, but delta has an extra delta-configure to control this, so

spark.databricks.delta.dynamicPartitionOverwrite.enabled, if true dynamic-overwrite, otherwise
respect the write option partitionOverwriteMode or spark sql configure spark.sql.sources.partitionOverwriteMode, which is dynamic or static

I tend to favor the iceberg's behavior, since it's more clear and enough for users to control this, and the addition of a new configuration would increase the learning curve for users, especially they already are familiar with spark.sql.sources.partitionOverwriteMode.

I try to respect the spark configure spark.sql.sources.partitionOverwriteMode, but found it's supported in datasource v2 as HoodieInternalV2Table only support V1_BATCH_WRITE TableCapability thus can't extend interface SupportsDynamicOverwrite

SupportsDynamicOverwrite is just a WriteBuilder interface, like SupportsOverwrite, you can implement it in HoodieV1WriteBuilder, i.e,
private class HoodieV1WriteBuilder(writeOptions: CaseInsensitiveStringMap,
                                   hoodieCatalogTable: HoodieCatalogTable,
                                   spark: SparkSession)
  extends SupportsTruncate with SupportsDynamicOverwrite with SupportsOverwrite with ProvidesHoodieConfig {
// ...
  override def overwriteDynamicPartitions(): WriteBuilder = {
    overwriteDynamic = true
    this
  }
}

then you need to update the method HoodieV1WriteBuilder#build to respect overwriteDynamic.
For V1 write path InsertIntoHoodieTableCommand, it's simple to read sparkconf to get the value of spark.sql.sources.partitionOverwriteMode and adapt the process accordingly.

I looked into how iceberg and delta handle this,
Iceberg
like @flashJd mentioned before:

Write option overwrite-mode, like HUDI's HoodieOptionConfig
Controlled by spark.sql.sources.partitionOverwriteMode, by implementing interface SupportsDynamicOverwrite, spark inside will handles this.

Delta
Roughly the same with Iceberg, but delta has an extra delta-configure to control this, so

spark.databricks.delta.dynamicPartitionOverwrite.enabled, if true dynamic-overwrite, otherwise
respect the write option partitionOverwriteMode or spark sql configure spark.sql.sources.partitionOverwriteMode, which is dynamic or static

I tend to favor the iceberg's behavior, since it's more clear and enough for users to control this, and the addition of a new configuration would increase the learning curve for users, especially they already are familiar with spark.sql.sources.partitionOverwriteMode.

I try to respect the spark configure spark.sql.sources.partitionOverwriteMode, but found it's supported in datasource v2 as HoodieInternalV2Table only support V1_BATCH_WRITE TableCapability thus can't extend interface SupportsDynamicOverwrite

SupportsDynamicOverwrite is just a WriteBuilder interface, like SupportsOverwrite, you can implement it in HoodieV1WriteBuilder, i.e,
private class HoodieV1WriteBuilder(writeOptions: CaseInsensitiveStringMap,
                                   hoodieCatalogTable: HoodieCatalogTable,
                                   spark: SparkSession)
  extends SupportsTruncate with SupportsDynamicOverwrite with SupportsOverwrite with ProvidesHoodieConfig {
// ...
  override def overwriteDynamicPartitions(): WriteBuilder = {
    overwriteDynamic = true
    this
  }
}

then you need to update the method HoodieV1WriteBuilder#build to respect overwriteDynamic.
For V1 write path InsertIntoHoodieTableCommand, it's much simple, we can read sparkconf to get the value of spark.sql.sources.partitionOverwriteMode and adapt the process accordingly.

1)SupportsDynamicOverwrite need the table capabilities BATCH_WRITE, now not support
2)V1_BATCH_WRITE not support DynamicOverwrite
https://github.com/apache/spark/blob/d4277b8e78347fd4e3163c6218edc4675ebb6db2/sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/TableCapability.java#L101C33-L101C33
3)We should implement v2 BATCH_WRITE in datasource V2 feature as a whole not here
so why not use an extra hudi-configure to control it like iceberg&delta

Add the ability OVERWRITE_DYNAMIC should be enough? Not sure what implement v2 BATCH_WRITE in datasource V2 feature as a whole means, this is my wechat: rexboom_an, can add me so we can fast align this.

Add the ability OVERWRITE_DYNAMIC should be enough? Not sure what implement v2 BATCH_WRITE in datasource V2 feature as a whole means, this is my wechat: rexboom_an, can add me so we can fast align this.

why not use an extra hudi-configure to control it like iceberg&delta

I mean we also need to add an option in HoodieOptionConfig to control this, but besides, can respect spark.sql.sources.partitionOverwriteMode since spark users are familiar with it.

Make a summary as we discussed, when come accorss an insert overwrite :

First respect hoodie.datasource.write.operation, if it is configured, then use it to insert overwrite partition/table
If hoodie.datasource.write.operation not configured, use a new hoodie config to control the behavor like iceberg/deltalake
if the new config is not set, then respect spark's spark.sql.sources.partitionOverwriteMode and it's default value is static
The behavor is not forward compatible but aligned with spark

@flashJd Since we already have a conclusion, do you have intreast to fix it for release 0.14.0 ?

@flashJd Since we already have a conclusion, do you have intreast to fix it for release 0.14.0 ?
Yea, sorry to late fix it, i"ll fix it today as we have discussed

As the behavor is aligned with spark but not forward compatible, we should notify this change in the release of 0.14.0

@boneanxs Can you help to take a look again ~

@hudi-bot run azure

The failed test should be a flaky one: https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=18976&view=logs&j=4c665d41-fe93-5d6b-3716-d7e63fa41849&t=f7ca1aa0-5550-5ab6-0ee3-d8a5a59e7ac4

@danny0405 @flashJd our version contains this pr，but insert overwrite table with partition also trigger overwrite table not overwrite partition

@danny0405 @flashJd our version contains this pr，but insert overwrite table with partition also trigger overwrite table not overwrite partition

Default behavior is overwrite table, use config to switch to overwrite partition, see tests


ATTiny85 oscillator calibration

I've noticed that I occasionally do not receive a response to the SEND_VOLTAGE command when issued.  Could be that the internal oscillator is not precise.  There's a register to calibrate the actual value.

Here's some good info about it: https://github.com/pepaslabs/CalibrateATtiny85OSCCAL

I believe the issue was due to my misuse of the internal 1mHz oscillator.  I don't think the bit-banged serial works at this speed.  Communication seems much more reliable when using the internal 8mHz oscillator.


How to change favicon and slides images?

Hi! I found both images of favicon and slides are in static file, but I can't find the place to customize those two in config.toml . Is there any place I can change them?

for the slides I believe you can change those in the data folder slide.json


contractcourt: add rapid derived fuzz test for HtlcAuxBlob

In this commit, we add a rapid derived fuzz test for the HtlcAuxBlob test. This uses the rapid (randomized property testing) into Go's built in fuzzer. This wrapper will use the fuzz stream, and pass that into rapid where the stream is used to make structured test inputs which are tested against the existing properties.
This can be done more widely in the codebase, we pick a simple example to port first before tackling others.

@bitromortac: review reminder


Can't run CARLA 0.9.7 on Ubuntu 19.10 with RTX2070

Error occurs when i run ./CarlaUE4.sh:
4.22.1-0+++UE4+Release-4.22 517 0
Disabling core dumps.
X Error of failed request:  BadDrawable (invalid Pixmap or Window parameter)
  Major opcode of failed request:  149 ()
  Minor opcode of failed request:  4
  Resource id in failed request:  0x2600041
  Serial number of failed request:  380
  Current serial number in output stream:  386
Signal 11 caught.
Segmentation fault (core dumped)

System is Ubuntu 19.10 with RTX 2070

@how to run with opengl ?


Problems with harmonising supplied soprano melody

Following instructions in the Readme file I tried the command
python3 deepBach.py -m melody1.mid -p -i 10000
with the attached midi file. The results were garbage: totally dissonant. I take it there is something wrong with either a) the settings I used or b) the midi file. Some help here would be appreciated.
melody1.mid.zip

Have you trained the model (the -t option?)
You may add more iterations too

I have a similar problem: First, I did python deepBach.py for training, but the created chorale is also totally dissonant.


Are we missing 'Sign out' or 'Log out' keys?

I want to have a 'Log out' or 'Sign out' button, but I cannot find the translation key for it.
Does it not exist?
Should it not exist here under sessions:
https://github.com/tigrish/devise-i18n/blob/master/rails/locales/en.yml#L106

I don't think devise provides a log out button in its views.

But isn't it used in almost all apps? Should we not support it? Are we tied to the device views? Should I then take it up with them? I thought this was a big deal but I could not find a related discussion about it

This gem exists to provide translations of the strings devise contains. There may be some source out there for translations of string used by almost all apps, but it's not this gem.


Printing Parsing report

Description
This PR adds a new test that doesn't block the CI but prints the parsing status for a set of high_priority commands by comparing the expected parses against ground truth files or predictions of semantic parsing model.
Please note that:

This PR adds a set of high-pri must have commands and their expected true logical forms (derived from here) .
This PR mimics how dialogue manager goes about getting the logical forms for an input command. i.e. first query ground truth file, if the command is not found query the model.

Fixes #40
This solves the issue of the parsing pipeline failing on the test commands and affecting progress downstream.
Type of change
Please check the options that are relevant.

[ ] Bug fix (non-breaking change that fixes an issue)
[ ] Proposes a change (non-breaking change that isn't necessarily a bug)
[ ] New feature (non-breaking change that adds a new functionality)
[ ] Breaking change (fix or feature that would break some existing functionality downstream)
[x] This is a unit test
[ ] Documentation only change

Type of requested review

[ ] I want a thorough review of the implementation.
[x] I want a high level review.
[ ] I want a deep design review.

Before and After
This test did not exist before.
Testing

Checklist:

[x] I have performed manual end-to-end testing of the feature in my environment.
[ ] I have added Docstrings and comments to the code.
[ ] I have made changes to existing documentation where needed.
[ ] I have added tests that show that the PR is functional.
[ ] New and existing unit tests pass locally with my changes.
[ ] I have added relevant collaborators to review the PR before merge.

@kavyasrinet This looks great! This should be CI blocking though if we want to ensure using this test that the parsing pipeline never regresses for critical commands, right?

@kavyasrinet This looks great! This should be CI blocking though if we want to ensure using this test that the parsing pipeline never regresses for critical commands, right?

Thanks ! Yes that makes sense. I'll add in an assertion.

Thanks ! Yes that makes sense. I'll add in an assertion.

would be possible to run the parser even on commands that are in gt, and generate a report about which commands failed to be properly parsed by nsp?   test would still only be blocking if the standard pathway with gt fail, this would just be extra info

would be possible to run the parser even on commands that are in gt, and generate a report about which commands failed to be properly parsed by nsp?   test would still only be blocking if the standard pathway with gt fail, this would just be extra info

Thanks! Yes I can print another table for the model only success and failures on these. So this would then generate two tables: one for overall parsing and one for parser only, would that help ?

related: https://github.com/fairinternal/minecraft/issues/1491

Thanks! Yes I can print another table for the model only success and failures on these. So this would then generate two tables: one for overall parsing and one for parser only, would that help ?

one table, two columns would be nicer?

Thanks! Yes I can print another table for the model only success and failures on these. So this would then generate two tables: one for overall parsing and one for parser only, would that help ?

one table, two columns would be nicer?

Whops sorry that's what I meant two "columns" not tables.

Pushed in changes for tracking model accuracy. Also updated the PR description with the new screenshots and description

Why is the name of the test file test_y_parsing? Can we use a more descriptive name?
Re the name, I put it so it is run at the end when CI runs the tests otherwise it is hard to read. Let me know if you can think of something better but merging this for now.


Switch dynamically linked releases to older libc for better compatibility

Current binaries can crash if ran on systems with an old libc

[tmigone] This issue has attached support thread https://jel.ly.fish/#/support-thread~dded1843-5c49-4a9a-9d65-8e00559e4c5c


Introduce token documentation

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 100.00%. Comparing base (ac11c63) to head (4f67f93).
Report is 1 commits behind head on main.

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@             Coverage Diff             @@
##                main      #301   +/-   ##
===========================================
  Coverage     100.00%   100.00%
  Complexity       733       733
===========================================
  Files             64        64
  Lines           2286      2286
===========================================
  Hits            2286      2286

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


chore: Add QueueURL() to the SQS provider iface

Fixes #N/A
Description
Add QueueURL() to the SQS provider interface
How was this change tested?
make presubmit
Does this change impact docs?

[ ] Yes, PR includes docs updates
[ ] Yes, issue opened: #
[x] No

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

5 of 6 (83.33%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.009%) to 82.27%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

pkg/providers/sqs/sqs.go
5
6
83.33%

Totals

Change from base Build<PHONE_NUMBER>:
0.009%

Covered Lines:
5336

Relevant Lines:
6486

💛  - Coveralls


UB-80: map/unmap SCB by host-name

This change is

Coverage increased (+0.9%) to 49.267% when pulling b18224338928b6eed192f16bc2c62c7361cad45a on feature/hostname_map_liort into d64525171386506631f9e3fc599e4254242e0c87 on dev.

this is a fake PR, just to demonstrate it to members,
so deleting this PR

fake PR

Coverage increased (+1.06%) to 49.381% when pulling b18224338928b6eed192f16bc2c62c7361cad45a on feature/hostname_map_liort into d64525171386506631f9e3fc599e4254242e0c87 on dev.


Speed optimization

Hi!
first, thanks four your work, i'm using it with my own data and it's fantastic! I'm working with a huge dataset, and using the batch_train function to update the model with new data (it's working fine, but I have to wait long times). My question is: is the model built taking in account the speed optimization? or, do you know if some part can be optimized in order to reduce batch_training speed? Any little reduction can be a great deal for me!
Thank you and congratulations!

hey @basque21 ! The easiest way is to throw machines & GPUs at it. Some cloud providers already offer clusters with TensorFlow installed and configured, so installing Magpie there should work out of the box. Batch training relies heavily on reading from disk, so if you can e.g. get SSDs instead of normal HD that might help as well.

Hi, thanks for your answer. And if there any way to take advance of the new feature use_multiprocessing in fit_generator with more than one worker? I'm trying it but not sure if I'm feeding data correctly to the model...

Hi basque21,
I want to utilize multiple GPUs too. Could you please provide more details about how do you change the model and some other steps? Thanks a lot for your great help.


Rodemap Of this project

Please Add Milestone Of this project.

thank you @JasonGT  . Lot Of programmer take intrest in simple .net core architecture. Your youtube video is view by more than 100k times. and if you read most of the comment.you noticed lot of  programmer want to use this architecture.  even i used this architecture in my project. But the problem is you and your team is not giving 100%  to this architecture pattern .Lot of thing is missing
1)this project is not well documented -lot confusion because this is not well documented. if i want to use dapper along with entity framework.so what can i do.
1.2)i tried to impediment identity server module in my project but i really dont know how and where.
2)Now yo add roadmap but not time span specified
3) ASP.NET Core Identity with implementing identity server
i just want to say it i really want to used this architecture in my project. but  last one month i check this git project and nothing happening. no major chnages is reflected in this project. So please as soon as complete ASP.NET Core Identity with implementing identity server

Hi again @CodeRapp3r
Thanks for your feedback. Some comments.

But the problem is you and your team is not giving 100% to this architecture pattern

It's just me, no team. I have a job, family, and other commitments - I can't give 100%.

1)this project is not well documented -lot confusion because this is not well documented. if i want to use dapper along with entity framework.so what can i do.

I'll look at adding a GitBook in the future. There is already some use of Dapper in this project.

2)if i want to use SQL Server with mango db . how? and where ?

https://docs.microsoft.com/en-us/aspnet/core/tutorials/first-mongo-app?view=aspnetcore-2.2&tabs=visual-studio

1.3)i tried to impediment identity server module in my project but i really dont know how and where.

Coming soon.

1.4) signaler implementation how? and where ?

https://docs.microsoft.com/en-us/aspnet/core/signalr/introduction?view=aspnetcore-2.2
I can't and won't cover everything. This solution in it's current state is just there to support the topics covered in the Clean Architecture talk. While I would love to help more, I simple don't have the capacity.
All the best.

@JasonGT  please replay as soon as possible . it really help
where you implement Identity server 4 ? In new separate project like Northwind.identityServer or in same Api  Northwind.WebUI project .  So accordingly i want to customize my project coding implementation
Y

Hi,
@JasonGT , thanks for sharing this repo, it helped me a lot, it made me think and change some key aspects in my design that, well, really helped me to boost my progress in a personal project.
@pranavpatil19 , don't get angry with me but I think you shoulnd't demmand that way, as JsonGT said this repository has general learning and teaching purposes although one can feel that is possible to create a company or a whole corporation just from here. That's not the case.
On the other hand, I'm currently creating my company and some of the code has been refactored recently to behave similar than NorthwindTraders Application Layer because I saw the video and I fell in love with Mediatr at first sight. Once said this I can give you some advices.
Starting from yopur last question Identity Server can be in the same solution but should be a separate project. I mean that regardless you can have your API and All the Identity server custom views in the same project I'd keep in a separate project but sharing some of the core libraries or at least the domain library so that your IDentityDbContext will know and manage all your identity entities and your CompanyDbContext can have its code domain entities but alse interact with Identity (to check roles or whatever other Bussines rule). In addition this will allow you to have federation and multiple clients with identity capabilities. That is pure separation of concerns, I mean, to apply SRP at software components level.
I you want to use SQL Server and Mongo DB you should have your Generic repository interface and your concrete SQLBasedRepository:IGenericRepository (that's just an example) and, well, in the case of Mongo you could have also MongoBasedRepository:IGenericRepository (Where T must be a document, I wrote a similar repo last year and it took me around 5 minutes to find the recipe and code it, I could sahre it if you ask me)... That is the how, I mean, none of those technolgies are new so it is quite easy to find recipes... Where? Well, there was a thread in this repo talking about if persistence layer, as is right now (or at is was, I'm not sure it changed) was against Clean Architecture principles. I had my own opinion about this nd I'll share it here. Methodologies are at our service and not the other way around, to decouple the application layer from the persistence layer can be tedious (you can think on doing some CQRS with microservices, I honestly would do that) but ASP NEt Core dependency injection worked very well for me....  That's the beauty I saw with Mediatr, the versavility it adds, the extreme separation of concerns you get. you can have a method in your API that requires something from a Document Database? the your command handler references a document repo and it uses it, and the handler implementation is concise because it goes straight to the point. Am I right?
(Maybe I'm writing too much, I only wanted to help, My answers in S.O. use to be like this too, with quick examples and opinions, that's the way I think)
NOTE: I've just reviewed what I wrote and I've found that, as I thought, My MongoDbImplementation was based on the Article thaty Json Shared, using MongoDB.Bson and MongoDB.Bson.Serialization.Attributes and MongoDbGenericRepository NuGet packges:
public class BlablablaRepository : BaseMongoRepository, IBlablablaRepository
    {
        public BlablablaRepository(string connectionString, string databaseName)
            : base(connectionString, databaseName)
        {
        }
    }

Last few words regarding SignalR: SignalR is a huge topic. The dev team has created a tremendous library with great features that are desirable to have in a lot of use cases but as the topic is huge the possibilities are huge. I've been using SignalR in many different projects during last ten years and every time I added SignalR to these projects I had to study and decide what was going to be the right approach, and that would occur today. JSon shared the best entry point to SignalR and from there the only thing that I would do is to create few Proof of concepts, in order to learn how to interact with it (i.e.: a remote console logger getting and showing every json message, a small javascript application with that chant example or, close to your real typescript application a small "chat module" that might be used or might become the seed for a real SignalR-based feature in your web app.
Again, sorry for this big bunch of messy words, I only wanted to help and, well, I'm open to help too with any question.

thank you very much @JuanGarciaCarmona  , i am not angry on you ...
I like to check SQL Server and Mongo DB  Generic repository ,if you dont have any problem please share me

I'm just writing you an email...


Fix for out of memory execption in js tests

🥳 would be great if this would actually solve the memory problems

We will see as for now it works as expected I tired to run CI several times and everything seemed to be ok.


Support JNI native methods

Closing this old issue. Java's new FFM API needs to be supported in a new issue.


Fresh install won't open, crashes with panic

Hi, I installed neovide from the AUR and expected it to just work, the following log shows what happens instead.
I have included a neofetch for system information.
❯ neovide                                                                                15:17:44
Ignored client type property: "methods"
Ignored client type property: "attributes"
thread 'main' panicked at 'index out of bounds: the len is 0 but the index is 0', /home/emifre/.cache/yay/neovide-git/src/neovide-git/CARGO/git/checkouts/skribo-3c422fce25a33836/a35c876/src/collection.rs:130:32
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

❯ neofetch                                                                                15:19:13
                   -`                    emifre@emifre-archpad
                  .o+`                   ---------------------
                 `ooo/                   OS: Arch Linux x86_64
                `+oooo:                  Host: 20T60027MX ThinkPad E14 Gen 2
               `+oooooo:                 Kernel: 5.11.16-arch1-1
               -+oooooo+:                Uptime: 6 hours, 23 mins
             `/:-:++oooo+:               Packages: 1101 (pacman)
            `/++++/+++++++:              Shell: bash 5.1.4
           `/++++++++++++++:             Resolution: 1920x1080, 1920x1080, 1920x1080
          `/+++ooooooooooooo/`           WM: dwm
         ./ooosssso++osssssso+`          Theme: Arc-Dark [GTK2/3]
        .oossssso-````/ossssss+`         Icons: Arc [GTK2/3]
       -osssssso.      :ssssssso.        Terminal: alacritty
      :osssssss/        osssso+++.       CPU: AMD Ryzen 7 4700U with Radeon Graphics (8) @ 2.000GHz
     /ossssssss/        +ssssooo/-       GPU: AMD ATI 05:00.0 Renoir
   `/ossssso+/:-        -:/+osssso+-     Memory: 4942MiB / 15285MiB
  `+sso+:-`                 `.-/+oso:
 `++:.                           `-/+/
 .`                                 `/

Hi, this solves the issue.
Thanks!


bluepy 1.3.0 error

Hello` i have hassio 0.103.0b0 and add Xiaomi MiKettle this respozytoty https://github.com/drndos/mikettle-ha, when aim Install bluepy: pip3 install bluepy i have this error 121.jpg

This is the bug/issue tracker for Home Assistant. Please use the forum for questions about installation, setup, configuration and usage.
mikettle is a custom component report your issues at https://github.com/drndos/mikettle-ha
If it's a Home Assistant bug, please re-open the issue with the issue template filled.


Weird publish error while publishing a new version to npm? (E403)

Affected Packages
cli?
Problem
I'm using a custom script for setting our pre-release versions, and I noticed an error sometimes from NPM.
The error I'm getting while publishing is:
error an error occurred while publishing @graphql-codegen/flow: E403 403 Forbidden - PUT https://registry.npmjs.org/@graphql-codegen%2fflow - You cannot publish over the previously published versions: 1.17.8-alpha-0f93aa04.0.
🦋  error In most cases, you or one of your dependencies are requesting
🦋  error a package version that is forbidden by your security policy.

I scanned the log, and noticed that changesets already checks that, and it seems valid:
// ...
🦋  info npm info @graphql-codegen/flow
// ...
🦋  info @graphql-codegen/flow is being published because our local version (1.17.8-alpha-0f93aa04.0) has not been published on npm
// ...
error an error occurred while publishing @graphql-codegen/flow: E403 403 Forbidden - PUT https://registry.npmjs.org/@graphql-codegen%2fflow - You cannot publish over the previously published versions: 1.17.8-alpha-0f93aa04.0.
🦋  error In most cases, you or one of your dependencies are requesting
🦋  error a package version that is forbidden by your security policy.
// ...

Maybe I'm missing something - but it seems like changesets looks for that package in that specific version, and it can't find it in NPM. But then when it tries to publish it, it fails because it already exists (?).
I checked and the package does exists on NPM, around the same time the pipeline was executed. I can only assume that the publish went fine, and the NPM error reflects something else?
This seems a bit random, because out of 40 packages, 30 worked correctly, and 10 has failed. I tried to run it again, but then it happens again, for different packages.

A complete log is here: https://github.com/dotansimha/graphql-code-generator/runs/944017592 or https://github.com/dotansimha/graphql-code-generator/runs/943997311

Proposed solution
No idea. Back then we had similar issues with E403 from NPM, and the messages was never informative enough, or mistaken. @ardatan suggested once that publishing many packages in short period of time causes issues, and it's better to limit the amount of publish command and not run all packages in parallel. We tried to limit the amount of publishing to maximum of 5 in parallel, and that seems to resolve the issue.
@Andarist

Hard to tell what might be the exact issue here - I would have to investigate the code responsible for the whole publishing process. It's important to assess if there are for example any automatic retries happening, how errors are handled etc. I can get to it, but it would probably take me some time - I'm having a lot of OSS issues in my backlog right now.
Just a note - we do limit how many internal publish commands are being executed in parallel, but I don't recall what's the exact limit right now. This piece of code would have to be examined as well to check for any potential logical issues.

@Andarist I'm not sure it's limited, according to this piece of code: https://github.com/atlassian/changesets/blob/master/packages/cli/src/commands/publish/publishPackages.ts#L73-L91
I think maybe we can wrap it with https://github.com/sindresorhus/p-limit ? and add a config field for setting the limitation.
I can open a PR for that, what do you think?

Update:
I tried to run the same thing 5 times: 4 times with the default limitation (40) and one time with modified version of it (5, using patch-package). All flows with 40 concurrent npm requests failed on publish command. The packages were published and seems valid, but it returns E403. With the 5 requests limit, it seems to pass correctly with no errors.
You can see it here: https://github.com/dotansimha/graphql-code-generator/pull/4498
I guess this issue only effect large codebases with more than a few packages, so that's why it happens for us.

Maybe we should have separate limitation for publish command, and allow to customize it with the config file?

I would start with just changing the limit - I don't see much value of having this configurable. Either a limit is good or either it is not - or maybe to rephrase: I don't see a value in being able to increase it.
I'm just wondering why this problem hasn't been surfaced earlier 🤔 There are already quite some Changesets users and I use it in a couple of multi-package repositories as well and I haven't bumped into it as well. I don't have repositories with so many packages managed by Changesets right now though, so maybe it's just that.
It hasn't been yet too problematic (or at least no one has reported issues with it), but we should handle this issue in the future. So assuming this is down the road - maybe we should just limit publishing to 1 at a time? It would technically be possible to implement parallel publishing in a topological order but it would increase the complexity quite a bit and I don't particularly see it being worth it. I also think that pnpm runs a single publish at a time given it awaits a single publish before moving onto the next one. Could you confirm this @zkochan ? @mitchellhamilton WDYT? do we need to run publish in parallel? benefits of this seem rather negligible for me

Given 5 or some limit works fine, we should probably go with that. I'm not overly concerned about the performance of publish given it's rarely going to be the bottleneck in a release workflow(especially because we encourage publishing on CI where installing dependencies is much more likely to be the bottleneck than publishing).

Right, that's my exact thinking - I'm just thinking that maybe even limiting it to 1 would be OK as that would make it easier to implement publishing in a topological order as that is something that we should do as well.

It seems like 5 works fine, tested with 6 and 8, both worked fine. 10 failed. I guess 5 is ok. But if you want to go with 1, I'm fine with it either (it will have some effect on our canary release pipeline performance, since we have ~40 packages).
Btw, why topological order is needed? just for verification or something else?

If A depends on B and we publish A first but fail (for whatever reason) to publish B then we might end up with a broken package A being on npm - it would potentially specify non-existent (on npm) version of B as its dep.
An alternative approach to a topological order is to publish packages in whatever order under a separate tag and switch the tag on all published packages after all packages are published. When I think about it now - this might be a better approach as it works better with cyclic dependencies 🤔

I'd +1 making a PR to lower this number for publishing


Updated outdated doc from 0.13 to 0.14

Method for building a StateNotifierProvider was not up to date since 0.14.0

PR fixing #514


markdown here always warns about the document being markdown, but not enabled

It is impossible to tell whether it is off or on. I've sent several markdown emails in plain text because of this. It always give the warning about being markdown but not enabled not matter how it is toggled. A toggle with no indicator is a terrible idea - it needs an on/off switch. As a result I never trust it when I am sending mail and well, have stopped trying to use it.

I don't understand.

It always give the warning about being markdown but not enabled not matter how it is toggled.

So, you're getting the "did you forget to render" prompt? But... what's not enabled? The Markdown Here button?
What client are you using (Chrome, Firefox, Thunderbird, etc.)? What email service (Gmail, etc.)?

A toggle with no indicator is a terrible idea - it needs an on/off switch.

Generally speaking, I agree that toggle switches are inferior. There's a complication with Markdown Here, though: the email is not necessarily only unrendered or rendered. If some of the email is selected when the button is pushed, only that part is rendered -- and then the email will be partly rendered and partly unrendered. And then what the button does next will differ depending on where the cursor is.
So, Markdown Here would have to keep monitoring the location of the cursor, the current selection, and the state of the text around the cursor. Not insurmountable, but more work and processing time.
Another complication: Chrome only lets you have a single toolbar button, and you can't change the icon -- you can only enable disable. (IIRC.)
I, personally, don't have trouble with toggle. For example, when I first created the extension, there was no button at all -- only a context menu item and a hotkey. And I still only use the hotkey. I don't have a trouble with remembering the state. But, yes, that's just me.
Anyway. I'd appreciate if you can answer the question at the top. I created a new issue for changing how the toggle button is displayed: #258.

I'm closing this issue, as your comment in #244 is that it's resolved for you.


[docs] Add bazel to the list of OT requirements

This is work from https://github.com/lowRISC/opentitan/pull/10041 that's
important to helping people set up to run OT
It also contains a bump in the described requirement for GCC8+, it's not
enforced by meson because I don't want this to depend on upgrading GCC
in CI
Signed-off-by: Drew Macrae<EMAIL_ADDRESS>

Here's an effort to address https://github.com/lowRISC/opentitan/issues/10335
Bazel's documentation on installation is pretty good, stable, and reasonably portable


Fix HttpRetryPolicy migration

HttpRetryOptions should be used

I'd be keen to try to be a first-time contributor with this issue - do you mean that HttpRetryOptions should be everywhere used instead of passing in the options separately, or the other way around?


Fixed broken links

Fixed broken links to AIRR Community WG pages in www.antibodysociety.org

thanks @ssnn-airr !