Investigate Optimizing JsonFlatten Serialization

Investigate manually handling JsonFlatten serialization instead of writing the object to a tree and mutating nodes. The following is code which was an initial investigation along with comments of its short-comings:
// Investigation into serializing the class ourselves to prevent string manipulation.
// Code below doesn't handle the following:
// - Null values are serialized without respecting ObjectMapper inclusion.
// - JsonType information isn't included.
if (defaultSerializer instanceof BeanSerializer) {
    BeanSerializer beanSerializer = (BeanSerializer) defaultSerializer;

    jgen.writeStartObject();

    Iterator<PropertyWriter> writerIterator = beanSerializer.properties();
    while (writerIterator.hasNext()) {
        BeanPropertyWriter writer = (BeanPropertyWriter) writerIterator.next();
        String jsonPropertyName = writer.getName();
        if ((writer.getMember().hasAnnotation(JsonFlatten.class) || classHasJsonFlatten)
            && CHECK_IF_FLATTEN_PROPERTY_PATTERN.matcher(jsonPropertyName).matches()) {
            String[] flatteningNames = SPLIT_FLATTEN_PROPERTY_PATTERN.split(jsonPropertyName);

            jgen.writeFieldName(flatteningNames[0]);
            jgen.writeStartObject();

            for (int i = 1; i < flatteningNames.length - 1; i++) {
                jgen.writeFieldName(flatteningNames[i]);
                jgen.writeStartObject();
            }

            jgen.writeFieldName(flatteningNames[flatteningNames.length - 1]);
            writeValue(jgen, writer, value);

            for (int i = 1; i < flatteningNames.length - 1; i++) {
                jgen.writeEndObject();
            }

            jgen.writeEndObject();
        } else {
            jgen.writeFieldName(jsonPropertyName);
            writeValue(jgen, writer, value);
        }
    }

    jgen.writeEndObject();

    return;
}

private void writeValue(JsonGenerator jgen, BeanPropertyWriter writer, Object value) {
    try {
        mapper.writeValue(jgen, writer.get(value));
    } catch (Exception e) {
        throw logger.logExceptionAsError(new UncheckedIOException(new JsonGenerationException(e, jgen)));
    }
}

Closing as this won't be done as the current direction is moving away from usage of this code path


This is a fix for #453 .

This is a fix for #453 .
_JAVA_OPTIONS is only set when oracle_tmp_stage != /tmp due to issues with GridSetup.sh -applyRU for 21c.
The default for oracle_tmp_stage is /tmp when ansible-fips is disabled or {{ oracle_stage }}/tmp when enabled.
The owner, group and priviledges for oracle_tmp_stage are set to same values as /tmp on normal linux servers.
The CV_ASSUME_DISTID is set to OL{{ ansible_distribution_major_version }} for RHEL/OL when not RHEL9/OL9 and set to OL8 when RHEL9/OL9.
SLES15 is default for SuSE at the moment. This could be changed in next PRs.
cluvfy is always executed without CV_ASSUME_DISTID, because the tool is compatible for all supported plattforms when most current version is used.

improves #452


A11y_SQL Azure Data Studio_Database_Create Project from database_Screen reader: Screen reader is not announcing " Section Headings" of "Create project from database" section. ·

GitHub Tags:
#A11yWCAG2.1; #A11ySev2; #A11yTCS; #DesktopApp; #BM_SQL Azure Data Studio_Win32_Aug2023; #SQL Azure Data Studio; #WCAG1.3.1; #ScreenReader; #Win32; #Benchmark; #FTP; #STP; #Element:Heading; #NVDA; #Narrator; #Info and Relationships;
Environment Details:
Application Name: Sql Azure Data studio
Version: 1.45.1
OS: Win11
Screen Reader: NVDA Version 2023.1(2<IP_ADDRESS>913)
Steps to Reproduce

Launch the application-Azure Database Project and install extension SQL Database Projects.
Navigate to SQL Database Project Home Screen with heading "Projects".
Tab to connections select your server and connect to it.
Now Turn on NVDA/Narrator.
Few databases will appear under your connection then right click on any database.
Tab till "Create project from database" and hit enter.
Now verify that NVDA/Narrator not announcing "Section Headings" of "Create project from database" section.

Actual Results:
Screen reader is not announcing "Section Headings" of "Create project from database" section.
Note:
Similar issue observed with NVDA.
Expected Results:
Screen reader should announce "Section Headings" of "Create project from database" section.
User Impact:
Screen reader user will not be able to know "Section Headings" of "Create project from database" section. If NVDA/Narrator not announcing.
Attachment:
SR is not announcing the heading along with label.webm
sr not announcing the heading along with label NVDA.webm

@PadminiGariki please test this with the updated extension I provided as soon as you can, since this has passed the SLA. Thanks!

verified the bug in this environment Latest insiders build.
Here issue is Not fixed.
for reference, please find the attachment.
#Reopened; #Regressed:10-31-23;
Issue is still repro in NVDA.webm
Issue is not fixed in Narrator.webm

@PadminiGariki that is not the latest version of the sql projects extension. Please make sure version 1.4.1 is installed as this is the version with the fix.

The section headers are no longer bolded in the latest version of the extension,

Screenreader announcing the section heading when the first item in the group is navigated to:
https://github.com/microsoft/azuredatastudio/assets/31145923/1ca2df11-09bb-4837-8eab-44e84b5fd61f

@kisantia
verified the bug in this environment Latest insiders build.
Here issue is Partially fixed. Here issue is fixed with NVDA but issue still repro in narrator.
for reference, please find the attachment.
#Reopened; #Regressed:11-09-23;
Narrator.webm
NVDA.webm

@PadminiGariki I thought as long as one screen reader on a platform is reading it correctly, then an issue can be resolved.

@PadminiGariki confirming that this is a Narrator issue. NVDA announces the section headings.

#External:Narrator; # External; #ED:PD:Narrator; #Regressed:11-21-23;

#ED:Ack:Wipro;

#ED:NoRepro; #Regressed:12-14-23;
@kisantia
This issue not only repro with Narrator. It is also repro with jaws.
Could you please verify the bug. For the reference attachment is added below.
issue repro with Jaws.webm


Notification origin is thought to be another application

I was just getting started with the lib so I tried first the snippet available in the "Usage" section of the README. My issue is that when I start it firstly the notification doesn't appear, though it is present in the notification center so that might be my os's fault (I use elementary loki) and I get the "NotificationClosed" log in the console and secondly the notification center thinks it comes from another application (that has previously created notifications if that's relevant). Is that a known bug? or is it maybe my system's handling of notifications that is not good?

Hum, I haven't encountered this error before, not sure if @sidorares has.
In the meantime, it would be good if you could definitely eliminate a possible problem from your notification server.
Can you try to install a minimalistic notification server so that we can be sure it is not on our side?
Something like dunst, or gnome-notification-center ?

Ah indeed, should have checked before. Using the notify-send tool with the --app-name option also creates a notification from the other application (the same one actually). So at least that part is not from your side. I'm inclined to believe the other issue is also due to elementary's notification server. I'll check further and move my issue to their repo.

Ok cool :-) Can I close?


Extract User-Agent string via Selenium

Currently, User-Agent string is hard-coded in Configurations.cs file.
We should attempt to extract User-Agent string from a Chrominum browser via Selenium.
See: https://stackoverflow.com/questions/43229299/how-to-get-useragent-information-in-selenium-web-driver

Implemented in 4832b7fade68361e941edce9338acebd6e09d555


Improving e2es and reducing removing some e2e-like unit tests

I've converted this back into draft as I am trying to figure out why the e2es seem to still not properly run


add remove_pub_address, remove_all_pub_addresses to the FIO protocol

This PR adds new endpoints and fio.address actions for remove_pub_address remove_all_pub_address.
contract actions are readdress remalladdr.
remove all is limited to NOT removing the FIO public address, this decision was made by the product team to eliminate the possibility of not being able to decrypt content in requests associated with the FIO Address.
remove pub address allows the removal of the FIO public address, though this is NOT recommended..
REQUIRED FEES
the remove_pub_address, and remove_all_pub_addresses fees must be added to the launcher. These have been added as a PR to the fio.devtools develop branch, merge this PR before testing these changes or fee errors will result.
TESTING performed..
the SOAPUI tests were run, all testes pass.
a new address was added to the Adam@dapixdev address on a local dev launched FIO blockchain.
this new address was removed using the remove_pub_address call.
the address was re-added.
then remove all pub addresses was run, and the results verified that only the FIO Address remained.
FURTHER TESTING CONSIDERATIONS

test with more addresses present, be sure to remove the last, and entries in the middle of the list of addresses using remove_pub_address.
2)test error scenarios on both calls, when one or more of the specified addresses do not exist.

Released as part of https://github.com/fioprotocol/fio.contracts/releases/tag/v2.1.0


Getting cls_logits NaN of Inf during training

I am training this retinanet 3D detection model with mostly the same parameters as the example in this repo, except with batch_size in the config = 1 because many image volumes are smaller than the training patch size.  During training, I am getting this error at random, several epochs into the training:
Traceback of TorchScript, original code (most recent call last):
File "/home/mycomputer/.local/lib/python3.10/site-packages/monai/apps/detection/networks/retinanet_network.py", line 130, in forward
if torch.isnan(cls_logits).any() or torch.isinf(cls_logits).any():
if torch.is_grad_enabled():
raise ValueError("cls_logits is NaN or Inf.")
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ <--- HERE
else:
warnings.warn("cls_logits is NaN or Inf.")
builtins.ValueError: cls_logits is NaN or Inf.
On the last few training attempts, this failed on epoch 6 on the first two attempts, then failed on epoch 12 on the third attempt.  So it can make it though all the training data without failing on any particular case.  Does anyone know what could be causing this?  If it's exploding gradients, is there something built into MONAI to clip these and prevent the training from crashing?  Thanks!

Hi @AceMcAwesome77,
The error message you're encountering, "cls_logits is NaN or Inf.", is letting you know that at some point in your training, the cls_logits tensor contains a Not a Number (NaN) or Infinity (Inf).
This can occur due to various reasons. This could come from a learning rate that's too high, instabilities in your numerical operations, uninitialized variables, or it could also be a problem with the specific data you're inputting into the model. It's a sign that the model is diverging, and gradients are getting out of control, which can also stem from exploding or vanishing gradients.
You indeed can attempt to mitigate this issue using gradient clipping, which can help ensure gradients never exceed a certain threshold. However, applying gradient clipping doesn't guarantee to resolve the root cause of the problem.
I would recommend looking at your training process more holistically. Inspect the learning rate, look for possible issues in the data, try normalizing the inputs, or use different weight initialization techniques.
Hope it helps, thanks.


Analyzer Feedback from IntelliJ

Version information

IDEA AI-211.7628.21.2111.8309675
2.18.6
AI-211.7628.21.2111.8309675, JRE 11.0.11+9-b60-7590822x64 JetBrains s.r.o, OS Windows 10(amd64) v10.0 , screens 1366.0x768.0

Please open an issue with details of your issue if you encounter this again.


sonatype repo?

@arjunguha -- this is is failing on travis due to not being able to find the appropriate jar. pushing the jar generates this error:
Failed to execute goal org.sonatype.plugins:nexus-staging-maven-plugin:1.6.3:deploy (injected-nexus-deploy) on project surveyman: Execution injected-nexus-deploy of goal org.sonatype.plugins:nexus-staging-maven-plugin:1.6.3:deploy failed: 403 - Forbidden -> [Help 1]

Do we still have the sonatype repository?

More lines:
[INFO]  * Upload of locally staged artifacts finished.
[INFO]  * Closing staging repository with ID "central_bundles-4743".

Waiting for operation to complete......

[INFO] Remote staged 1 repositories, finished with success.
[INFO] Remote staging repositories are being released...
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:02 min
[INFO] Finished at: 2015-08-15T23:36:48-07:00
[INFO] Final Memory: 91M/447M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.sonatype.plugins:nexus-staging-maven-plugin:1.6.3:deploy (injected-nexus-deploy) on project surveyman: Execution injected-nexus-deploy of goal org.sonatype.plugins:nexus-staging-maven-plugin:1.6.3:deploy failed: 403 - Forbidden -> [Help 1]


Fixes here urls and apiKey authentication

Fixes here urls and apiKey: Bug 286
_geocodeEndpoint:
https://geocoder.ls.hereapi.com/6.2/geocode.json
_reverseEndpoint:
https://reverse.geocoder.ls.hereapi.com/6.2/reversegeocode.json

It should be fixed now sorry for the delay


go-to-protobuf incorrectly generates godocs

This is a tracker issue tracking https://github.com/kubernetes/code-generator/issues/107.

This issue was observed during review of https://github.com/kubernetes-sigs/service-apis/pull/163.

xref #210

Protobuf generation was removed, so this issue is no longer needed.
/close


Refactor colorscheme code organization

This change removes the colors.vim config file because it handles
something that is personal. Following our guideline, everything personal
must be in my_config.vim. So, this orientation was put on README and
installation process was changed to not use this file anymore.
Now when user enables color support the installation script only add
colorscheme.vim to the vimrc file.

Forget it.


Support embedded cartridges

Pom files don't get their own repo.  Perhaps Cartridges don't always need on either.  How about the cartridge loader goes a recursive find for the first metadata.cartridge file and it finds and treats that as the cartridge root?
Happy to implement but only if you'll accept this.
I recognise I will need to think about avoiding the repo getting loaded twice (once as the local copy of the cartridge and once if someone re-states it in the urls.txt file).

I like the idea, don't see much value to sync and keep all cartridges by default in my Gerrit  👍

@SachinKSingh28 @nickdgriffin what do you think guys?

Created a PR: #18

PR #18 was accepted, this is done!


Improvements to latexify

A few improvements to latexify, mostly motivated by printing the SEI models.

[ ] Integrals currently displays xn as integration variable.
[ ] Definite integrals are not taken into account.
[ ] Add SEI, inner and outer subscripts.
[ ] Use Roman d in derivatives (rather than maths).

Feel free to extend this list.

@brosaplanella If you're OK with this, I can try to write a patch.

I am not sure why we chose standalone originally (@tinosulzer, @rtimms  and @priyanshuone6, do you remember?). Standalone is useful for small systems, so maybe we could add an extra keyword argument to choose which latex class we want (either standalone or article).
In any case, if we choose article we should definitely change the margins as the default ones are incredibly large.


Disables testsales.nim

This test file is disabled while the race-condition in preparing.nim is being solved.
https://github.com/codex-storage/nim-codex/pull/816

Fixed in https://github.com/codex-storage/nim-codex/pull/825


enable integration test

/assign @pmorie

/assign @deads2k

/approve

/lgtm

@skeeey will you make a PR to openshift/release to add a job for this test?


New Term Requests: Cancer-related subtypes of treatment

The Ontology for Biobanking (OBIB) has requests from the NCI Biorepositories and Biospecimen Research Branch (BBRB) that involve treatments of cancer. Scoring of functional impairment will be defined later based on these treatments. Axioms are suggested but if problematic and cause significant delays can go with just textual definitions.
Treatment for cancer: a treatment that has the objective to kill or remove cells that have uncontrolled cellular proliferation, local cell invasion, and metastasis.
Alternative term: cancer treatment
Subclasses and axioms: treatment (http://purl.obolibrary.org/obo/OGMS_0000090) and achieves_planned_objective some (‘objective specification and is about cancer DOID:162)
Surgical treatment for cancer: a treatment for cancer that involves a surgical procedure as a main part.
Subclasses and axioms: ‘treatment for cancer’ and has part some ‘surgical procedure’ (http://purl.obolibrary.org/obo/OMIABIS_0001041)
Adjuvant treatment for cancer: a surgical treatment for cancer that involves chemotherapy or radiotherapy as an additional component of treatment.
Definition source: http://www.medicinenet.com/script/main/art.asp?articlekey=2151
Subclasses and axioms: surgical treatment for cancer and has part some (chemotherapy http://purl.obolibrary.org/obo/IDOMAL_0001284 or radiotherapy http://purl.obolibrary.org/obo/OAE_0000235).

How about this change?
Adjuvant treatment for cancer: a surgical treatment for cancer that involves an additional component of treatment such as chemotherapy, radiotherapy, or immunotherapy.
Definition source: http://www.medicinenet.com/script/main/art.asp?articlekey=2151
Subclasses and axioms: surgical treatment for cancer [leave off specifying other treatments]

That sounds okay to me. You leave it open for other kinds of treatments.
Also, not sure if this is important, but the NCI Thesaurus seems to prefer
'therapy' over 'treatment'. E.g., Adjuvant therapy. I'm not sure if there
is a medical distinction between the uses of 'treatment' and 'therapy'.
On Tue, May 23, 2017 at 2:21 PM, cstoeckert<EMAIL_ADDRESS>wrote:

How about this change?
Adjuvant treatment for cancer: a surgical treatment for cancer that
involves an additional component of treatment such as chemotherapy,
radiotherapy, or immunotherapy.
Definition source: http://www.medicinenet.com/script/main/art.asp?
articlekey=2151
Subclasses and axioms: surgical treatment for cancer [leave off specifying
other treatments]
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/OGMS/ogms/issues/112#issuecomment-303488372, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ADCfzoW1PtukTO7VxtA8tCT8VTZP8xqEks5r8yOVgaJpZM4Nj_ns
.

Treatment is defined in OGMS but not therapy and these uses fit within treatment so am arguing for sticking to that. Could be open though to alternative term: adjuvant therapy


pulley: Get simd_boolean.wast test passing

Fill out some bitmask/test instructions for vectors.

Currently built on https://github.com/bytecodealliance/wasmtime/pull/9839


Configure management scripting for DCE Demo AWS environment

Full test of the ansible scripts 3/21 was successful. Closing this ticket now - as we uncover other issues we can file separate tickets.


php bug

I expect that 'desktop' is colored green.
Code:
<?php
new class {
     public static function getUserByLogin(string $userName, string $password, string $app = 'desktop') {
        $request = null;
        try {
            $request = RequestUtil::doRequest(HttpMethod::POST, '/auth/login', [
                'json' => [
                    'login' => $userName,
                    'pass' => $password,
                    'app' => $app
                ]
            ]);
        } catch(HitboxApiException $e) {
            throw new HitboxAuthException('Cannot authenticate with hitbox api! Check username or password.', 0, $e);
        }
    }
}

I think it was a illegal syntax, and it's background color  should be red.

Like this

Well, it's not. That's a new feature introduced in newer versions of php.

Yes, it was a failure. I was in the wrong language.

Should I update it? 😂

Yeah, please. So it won't irritate me again.

@jens1o
Please update and check it

No, that doesn't fix it:

Now it's looking normal, while I expect red background.

@jens1o
Oh, I misunderstand your mean

@jens1o
VS Code can't change the code background color, so I can't make it's background be red
This screenshot is atom's

Okey. Is there any other way?
Do we need the white thing? Maybe make it red?(But I'm not a designer)

@jens1o
I change it pure red color

Works. Thanks!

I'm pulling this up. From PHP 7 on, this is valid syntax. That's why there is an additional class added:

@jens1o
We should wait until VS Code official support it

Okay, where is the grammar repo?

@jens1o
I think here it is
https://github.com/Microsoft/vscode/tree/master/src/vs/workbench/services/themes

@jens1o can you tell me the font name of your php file, its looked nice😲

No problem, it's the free Fira Mono from Mozilla! https://github.com/mozilla/Fira

@jens1o thx for your detailed answer,its kind of u.😜

The problem has been fixed, the php grammar has been updated. Anyway, @Binaryify could you consider publishing a new version?

@jens1o
Oh~, I forgot it


wrong credential with dreame A1

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior.
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Additional Information (please complete the following information)

Model Name [e.g. dreame.vacuum.p2028]:
Firmware Version [e.g. 1156]:
Home Assistant Version:
Configuration Type [With or without map support]:
Errors or warnings shown in the HA logs (if applicable):

Hi everyone
i have this message : wrong credential with stable or beta with my dreame A1 (but credential work on my account dreame on my phone)


Memory leak?

Description
Hi,
Yesterday we upgraded from 1.21.10 to 1.22.1.
1.21.10 was running with around 500 MB RAM used.
1.22.1 goes crazy with RAM while having a lot of reads on the disks and being so slow users think it is broken.
Any ideas?
Thanks a lot!
Gitea Version
1.22.1
Can you reproduce the bug on the Gitea demo site?
No
Log Gist
No response
Screenshots

Git Version
2.43.5
Operating System
Oracle Linux 8
How are you running Gitea?
Using the downloads from Github for Linux AMD64, running as service on OL8.
Database
MySQL/MariaDB

We have lots of messages like these in the logs:
2024/07/05 14:23:45 ...eb/routing/logger.go:68:func1() [W] router: slow      POST /somecontext/blabla for <IP_ADDRESS>:55682, elapsed 3078.6ms @ repo/githttp.go:477(repo.ServiceUploadPack)

We have lots of messages like these in the logs:
2024/07/05 14:23:45 ...eb/routing/logger.go:68:func1() [W] router: slow      POST /somecontext/blabla for <IP_ADDRESS>:55682, elapsed 3078.6ms @ repo/githttp.go:477(repo.ServiceUploadPack)

Seems to be the same issue as #31565
Disabling the index fixes the issue.


application not responding on Mac OS Big Sur

apple@192 ~ % java -version
java version "1.8.0_212"

apple@192 ~ % echo $JAVA_HOME
/Library/Java/JavaVirtualMachines/jdk1.8.0_212.jdk/Contents/Home

I have the same issue.

Seems to be duplicate of #9533
Workaround: download pkg installer.


Force inline of hot functions.

This is PoC patch and work still in progress, so ignore it for now.
Binary size:

Before 198352 Aug 19 14:00 jr-master*
After:  198352 Aug 19 14:43 jr-jrt*

Native build on RaspPi2:
                           Benchmark |         RSS
(+ is better) |        Perf
(+ is better) |
                           --------- |                          --- |                         ---- |
                          3d-cube.js |          164->   164 (0.000) |       5.816->5.57067 (4.218) |
              access-binary-trees.js |           96->    96 (0.000) |       3.088->2.98133 (3.454) |
                  access-fannkuch.js |           48->    48 (0.000) |      14.0613->13.468 (4.219) |
                     access-nbody.js |           76->    76 (0.000) |        6.208-> 5.952 (4.124) |
         bitops-3bit-bits-in-byte.js |           36->    36 (0.000) |     4.61867->4.46267 (3.378) |
              bitops-bits-in-byte.js |           36->    36 (0.000) |     6.59733->6.30933 (4.365) |
               bitops-bitwise-and.js |           28->    28 (0.000) |      4.01333->   3.9 (2.824) |
            controlflow-recursive.js |         224->   228 (-1.786) |     3.56667->3.43067 (3.813) |
                date-format-xparb.js |          112->   112 (0.000) |       3.784->3.72933 (1.445) |
                      math-cordic.js |           48->    48 (0.000) |      7.37067-> 7.052 (4.324) |
                math-partial-sums.js |           40->    40 (0.000) |       3.004->2.91867 (2.841) |
               math-spectral-norm.js |           56->    56 (0.000) |      4.02267-> 3.844 (4.442) |
                     string-fasta.js |           56->    56 (0.000) |     35.3053->35.0893 (0.612) |
                     Geometric mean: |       RSS reduction: -0.136% |            Speed up: 3.3958% |

Are you sure the binary actually changes with this patch? It's somewhat suspicious that the binary size before and after the patch is identical (especially when tweaking inlining settings).


Add prestige, unlock requirements and breaketernity.js to incrustmental

It will be awesome if the creator added prestige layers to incrustmental where the player needs an certain amount of money to prestige.
prestige will reset all products and money of that previous layer and unlock new permanent upgrades for the player to buy.
also, it will be cool if the creator adds unlock requirements for upgrades, products and etc.
Also, once again, it will be great if the creator of incrustmental putted breaketernity.js to format large numbers with ease.

If I'm understanding what's desired correctly, there's 3 features here:

Add prestige API for managing resets and special perks (probably needs some discussion)
Add some kind of achievable goal to unlock an upgrade, product, other API
Add an API for handling orders of magnitude and very large numbers in display

@Blazindude365 - does this sound correct?

Yes, that's correct

Sounds, great guys.
Unfortunately, I don't have much time to work on that currently, but if you make a PR I'll take a look.
Also, about 2. - we already have Conditions and Relation. They can be used (and if needed extended) to achieve that purpose.
Cheers!

but if you make a PR I'll take a look.

My questions were along this line - I don't know if I can implement 1 without a better understanding of the perks system, but for 3, I will see if I can come up with a port of breaketernity or at least implement something that can do what it does. I have done something like this before, but it was in Swift, maybe some of it will translate.
All that said to say, this is probably better suited as 3 issues, which I'll gladly break it apart if @Blazindude365 will allow me to do so, using the 3 features I listed above.

Sure, go ahead for the issues
As for breaketernity - I found two rust crates so maybe we can use them


Create date-time feature engineering function

Use the HCRTools example in common.R as an example.

[ ] implement feature engineering
[ ] test coverage

For people who doesn't understand R, it might be better to write out what the date-time engineering function does?


Add isolate function

Consider a procedure like this.
sum!(arr: [Int; _]): Int =
    s = !0
    for! arr, i =>
        s.inc! i
    s

This procedure has no "external" side effects, aside from being able to be rewritten in the FP side-effect-free style. The side effects are completely localized internally. We want to be able to treat this as a function.
So, I propose the following isolate function.
isolate: |T: Type|(proc!: (() => T) and Localized) -> T

Localized trait means the procedure is completely localized and has no external influence.
sum! can be converted into sum using the isolate function as follows.
sum(arr: [Int; _]): Int =
    sum!() =
        s = !0
        for! arr, i =>
            s.inc! i
        s
    isolate sum!

I've added a function perform to the unsound module. This allows you to circumvent Erg's effects analysis.
print x =
    unsound.perform do! print! x

print "hello"

This is similar to isolate, but it is more powerful and unsound. It can execute non-localized procedures.


Starting a container from a checkpoint is not working

containerd at master (and in the version currently vendored into Docker), seems to no longer allow you to restore a container from a checkpoint.
Given a prepared redis rootfs at /redis, I ran:
$ ctr containers start red /redis

$ ctr checkpoints create red test

$ ctr containers start --checkpoint=test --checkpoint-dir=/redis/checkpoints red1 /redis
> [ctr] rpc error: code = 2 desc = exit status 1: "cannot start an already running container\n"

I discovered this by just trying to rebase the docker-checkpoint-restore branch against latest master and realizing that restores no longer worked. I haven't yet tracked down the actual problem.

Had a quick look.
This is caused by runc. runc restore does not support the new create/start combination and containerd relies on this to setup monitoring before the container process is started.
@crosbymichael should we add a switch to runc restore to have it behave like create when specified?

ping @crosbymichael ptal

Now that 1.12 has shipped it would be really great to resolve this issue so we can get C/R merged into Docker. @mlaventure I think you're right about what the issue is, but I'm not familiar enough with the code to get this done quickly and don't have much time for the next couple of weeks to look into it.

Is there an owner for this issue? I would like to start trying out @boucher's C/R integration.

Any updates on this? Would really like to try out the new C/R integration. I'm still using the experimental 1.10 build because of this issue, and it's becoming more and more of a pain to have to fallback to such an old daemon.

Hey @crosbymichael @mlaventure @boucher I'm willing to try and solve this if no one else is already actively working on it.

That would be great!

@estesp that'd be very helpful thanks! I'll be busy on other things for a little while before I can start looking at a solution for this.

Referenced PR allows restore via containerd
@boucher would love for you to do some more testing--only thing I've noticed is that created time of the restored-from-checkpoint runc container is the epoch time (defaulting to zero), but I think that would be a bug in runc restore as I can't see containerd having anything to do with that.

I've tested this running in the full docker c/r cycle and it's working great!

@boucher what's the easiest way to consume this functionality? Through containerd 1.0?

@alexellis This issue is from an older version, but the functionality is currently available on Docker if you enable the experimental features. There's also an implementation targeting the new 1.0 containerd in this pull request: https://github.com/containerd/containerd/pull/862


Soundcloud support

Just saw a quick look and there is a web api but haven't looked at what features it supports.

Any update on this? would be nice because I swap between Spotify and Soundcloud pretty often and I see myself looking at the taskbar when I'm using soundcloud haha


Improves test suite

Status
Type
⚠ Core Change
Issue

Ready
Features/Tooling/Refactor
Yes
Closes #34

Problem
What problem are you trying to solve?
Further improvements to test suite see #34
Adding helper methods to PerpMarket, OrderBookSide etc

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

113 of 123 (91.87%)  changed or added relevant lines in 14 files are covered.
1 unchanged line in 1 file lost coverage.
Overall coverage increased (+30.09%) to 81.274%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

Solnet.Mango/Models/MangoGroup.cs
29
31
93.55%

Solnet.Mango/Models/Perpetuals/PerpMarket.cs
0
2
0.0%

Solnet.Mango/MangoClient.cs
22
25
88.0%

Solnet.Mango/Types/I80F48.cs
3
6
50.0%

Files with Coverage Reduction
New Missed Lines
%

Solnet.Mango/Types/I80F48.cs
1
50.31%

Totals

Change from base Build<PHONE_NUMBER>:
30.09%

Covered Lines:
2114

Relevant Lines:
2565

💛  - Coveralls


Implement redirecting factory bodies

These seem to be unimplemented.  They are used in the core libraries (e.g., class Map).

We discussed this, and for now we'd just like to replace calls to redirecting constructors with a call to their actual target.
An example where this doesn't happen is in NoSuchMethodError._throwNew in the VM's core library implementation.  The call new Map<Symbol, dynamic> should redirect to new LinkedHashMap<Symbol, dynamic> which is a regular (not redirecting) factory constructor.

Proposed fix in CL<PHONE_NUMBER>.


TypeError: mysql.createConnection is not a function

please help this error...
this is my code

this is my error

this is my project window

could you paste the above code as text @aznaLee ?

The project window screenshot doesn't look right, as the mysql folder should have an index.js file in it. I wonder if the installation is corrupted? Can you paste the output of npm ls from that project directory as well?

@dougwilson  mysql folder have an index.js ... i try paste the output of npm ls project directory, no problem..
@sidorares hmm...?

@aznaLee first picture - could you copy/paste this text as text, not image?

@sidorares ah..
var mysql = require('mysql');
var connection = mysql.createConnection({
host : '<IP_ADDRESS>',
user : 'root',
password : 'mysql'
});
connection.connect();
connection.query('SELECT "Hello World"', function(err, results, fields){
if(err)
{
throw err;
}
console.log(results);
console.log(fields);

});
connection.end();
like this?

yes. just wanted to check if you have any special chars in createConnection

In your screenshot, the mysql folder looks very wrong; it does nit have an index.js file, it is missing the Changes.md file, and there should not be a test folder.

I'm closing this issue since we gave a couple suggestions but haven't heard back in 20 days so far. Let us know if you're still having issues and we can re-open the issue :)

I have this issue


add(api/kafkauser_types): description for SecretName

Description
What's in this PR?
Added description for SecretName field of KafkaUser CRD's type file.
Why?
SecretName filed in a KafkaUser resource should be unique inside the namespace where KafkaUser is because  a secret will be generated, with the same name as SecretName, for every KafkaUser in the KafkaUser's namespace and this secret will contain the certificate of the KafkaUser. If a secret already exists with the desired name in the namespace, the certificate generation process will fail.
Additional context
Link for the task: https://cisco-eti.atlassian.net/browse/CAL-2263
Type of Change

[ ] Bug Fix
[ ] New Feature
[ ] Breaking Change
[ ] Refactor
[x] Documentation
[ ] Other (please describe)

Checklist

[x] I have read the contributing guidelines
[x] Existing issues have been referenced (where applicable)
[x] I have verified this change is not present in other open pull requests
[x] All code style checks pass

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Sync writes with serial dispatch queue in GRXBufferedPipe

An attempt to fix the issue reported in #10957. All access to member _state of GRXBufferedPipe are now synchronized with GRXBufferedPipe itself, and all access to member _queue is serialized with a dispatch queue.
I was unable to reproduce the exact sequence of events in #10957 with a test. Would love to hear any idea on how to test this.

Did you try the approach of substituting the array with the dispatch queue itself?


feat(RepositoryCache): No hashing in cache key

Summary
No ticket. Hotfix to address GL alert boundary issue at Park St discussed in Slack.
What is this PR for?
Removes unnecessary affected entities that are causing the app to show a Westbound suspension at Park St, when really there is only an Eastbound suspension.
Before & after:

This is absolutely not the changeset I was expecting


[Refactoring] Refactor architecture of OUDS Swift Package product for helpers and view modifiers

Prerequisites

[X] I have searched the backlog for duplicate or closed feature requests

As a
user of the library
... I want to
have all view modifiers in same target / Swift package product (like OUDS)
... so that I can
get all helpers in a same place using lower levels products
Motivation and context
Get things cleaner
Proposed Solution

Make some renaming, for example public func typeDisplayLarge(_ theme: OUDSTheme) -> some View should be  public func oudsTypographyDisplayLarge(_ theme: OUDSTheme) -> some View

Move modifiers to OUDS Swift package product (are here today in OUDSComponent)

Do the szme with shadow helps

View modifiers should be in Modifiers subfolder

A11Y things should be in A11Y subfolder of Modifiers

Typography things should be in Typography subfolder of Modifiers

Other
No response
Contact Details
No response

on hold until https://github.com/Orange-OpenSource/ouds-ios/pull/137 is merged to prevent conflicts and boring rebase


featuremanager: Lack of safety features

WIP

@ovidiutirla, would you be able to expand on this a bit? That would help others to understand what this issue is aiming at, and make it easier to collaborate with you.
If it's a subtask of a "featuremanager" feature, maybe opening an epic-style issue that can hold subtasks and also holds the larger context might also be useful.

I'm going to add kind/enhancement to this because it seems like a featuremanager is an enhancement, but some more detail would be great, thanks!

Closing for now. yes, this was related to a draft PR I was working on. Had it with WIP as we were still discussing some parts.


Autocompletion per PEP 526 Type Annotations Not Working For List[x] where x is int, str, etc...

Environment data

VS Code version: 1.26.1
Extension version (available under the Extensions sidebar): 2018.7.1
OS and version: macOS 10.13.6
Python version (& distribution if applicable, e.g. Anaconda): 3.7.0 (pyenv, miniconda)
Type of virtual environment used (N/A | venv | virtualenv | conda | ...): conda, pyenv
Relevant/affected Python packages and their versions: NA

Actual behavior
Type hinting not working for some PEP 526 style annotations (in my case List[?] does not work)

Expected  behavior
Type hinting to recognize variable type annotations in the function declaration.  Screenshot below of what I would expect from above (note in the function declaration I did not specify the type in the list).

Steps to reproduce:

Create new python file

Specify any Python 3.6+ interpretter

fill out
from typing import List

def foo(a: List[int]):
   a.# now wait for auto-complete

Logs
Output for Python in the Output panel (View→Output, change the drop-down the upper-right of the Output panel to Python)
Starting Microsoft Python language server.
[Info  - 3:56:19 PM] Created Microsoft.PythonTools.Interpreter.Ast.AstPythonInterpreter instance from Microsoft.PythonTools.Interpreter.Ast.AstPythonInterpreterFactory
Initializing for /Users/ogi/.pyenv/versions/miniconda3-latest/bin/python
[Info  - 3:57:41 PM] Found 198 completions for file:///Users/ogi/Academic/CS532/demo/test.py at (1, 2) after filtering
[Info  - 3:57:42 PM] Found 334 completions for file:///Users/ogi/Academic/CS532/demo/test.py at (1, 7) after filtering
[Info  - 3:57:43 PM] Found 1 completions for file:///Users/ogi/Academic/CS532/demo/test.py at (1, 14) after filtering
[Info  - 3:57:44 PM] Found 119 completions for file:///Users/ogi/Academic/CS532/demo/test.py at (1, 21) after filtering
[Info  - 3:57:45 PM] Found 119 completions for file:///Users/ogi/Academic/CS532/demo/test.py at (1, 21) after filtering
[Info  - 3:57:47 PM] Found 199 completions for file:///Users/ogi/Academic/CS532/demo/test.py at (3, 2) after filtering
[Info  - 3:57:50 PM] Found 182 completions for file:///Users/ogi/Academic/CS532/demo/test.py at (3, 13) after filtering
[Info  - 3:57:52 PM] Found 182 completions for file:///Users/ogi/Academic/CS532/demo/test.py at (3, 18) after filtering
[Info  - 3:57:54 PM] Found 204 completions for file:///Users/ogi/Academic/CS532/demo/test.py at (4, 6) after filtering
[Info  - 3:57:54 PM] Found 2 completions for file:///Users/ogi/Academic/CS532/demo/test.py at (4, 7) after filtering

Output from Console under the Developer Tools panel (toggle Developer Tools on under Help)
workbench.main.js:sourcemap:1397  INFO no standard startup: panel is active
workbench.main.js:sourcemap:4188 Overwriting grammar scope name to file mapping for scope source.swift.
Old grammar file: file:///Applications/Visual%20Studio%20Code.app/Contents/Resources/app/extensions/swift/syntaxes/swift.tmLanguage.json.
New grammar file: file:///Users/ogi/.vscode/extensions/Kasik96.swift-0.0.3/syntaxes/swift.tmLanguage
e.register @ workbench.main.js:sourcemap:4188
workbench.main.js:sourcemap:1398   ERR Illegal argument: character must be non-negative: Error: Illegal argument: character must be non-negative
    at Object.t.illegalArgument (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:95:675)
    at new e (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:472:92)
    at e.translate (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:473:725)
    at getPrecedingRange (/Users/ogi/.vscode/extensions/njpwerner.autodocstring-0.2.3/src/extension.ts:55:39)
    at processEnter (/Users/ogi/.vscode/extensions/njpwerner.autodocstring-0.2.3/src/extension.ts:41:17)
    at activateOnEnter (/Users/ogi/.vscode/extensions/njpwerner.autodocstring-0.2.3/src/extension.ts:35:9)
    at context.subscriptions.push.vs.workspace.onDidChangeTextDocument.changeEvent (/Users/ogi/.vscode/extensions/njpwerner.autodocstring-0.2.3/src/extension.ts:23:34)
    at e.fire (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:98:218)
    at e.$acceptModelChanged (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:728:571)
    at e._doInvokeHandler (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:671:983)
    at e._invokeHandler (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:671:701)
    at e._receiveRequest (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:670:767)
    at e._receiveOneMessage (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:670:536)
    at /Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:669:452
    at /Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:672:575
    at /Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:96:903
    at e.fire (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:98:218)
    at a (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:162:713)
    at Socket._socketDataListener (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/node/extensionHostProcess.js:162:932)
    at emitOne (events.js:116:13)
    at Socket.emit (events.js:211:7)
    at addChunk (_stream_readable.js:263:12)
    at readableAddChunk (_stream_readable.js:250:11)
    at Socket.Readable.push (_stream_readable.js:208:10)
    at Pipe.onread (net.js:594:20)
2workbench.main.js:sourcemap:1398   ERR Cannot read property 'map' of null: TypeError: Cannot read property 'map' of null
    at asCompletionResult (/Users/ogi/.vscode/extensions/ms-python.python-2018.7.1/node_modules/vscode-languageclient/lib/protocolConverter.js:145:51)
    at <anonymous>

I can replicate this.
@MikhailArkhipov can't quite decide if I want to make this a P1 since a decent amount of type hints will be a generic like this, but it also doesn't crash the language server or prevent it from working otherwise.

@j9ac9k I can reproduce on VSC 1.28.0 and Python 2018.9.0
Autocompletion with type annotation only works for me if I use Python 3.6.6 as interpreter and Jedi as Intellisense engine.
It does NOT work with:

Microsoft Python Analysis Engine (any Python interpreter).
Jedi as engine and Python 3.7.0

@j9ac9k In my case, looks like a: List works, but not a: List[int]

@egabrum that's the case I'm seeing too.

@MikhailArkhipov would it work if you just did a. (and await auto-complete), ...or in other words, does it recognize that a is a list?

I'm not sure that the generic type List requires more than that it can be indexed (__getitem__) and iterated (__iter__), versus also including things like append or copy: https://docs.python.org/3/library/typing.html#typing.List

You caught me just as I was editing my comment to strike that out. 🙂 Using List or list works fine.
After reading through typing.py in the typing repo, it looks like List is defined as:
class List(list, MutableSequence[T], extra=list):

Which implies that it's being treated as a subclass of list, so the analysis we do should have probably also shown those methods. There's likely something we need to fix for List[T]. Since this is a language server thing, we'll probably be investigating more over on Microsoft/python-language-server#260.

FWIW I think jedi is behaving the same way (or something weird and unique on my system)
Anyway if there is anything else I can help with testing, please let me know.

https://github.com/Microsoft/python-language-server/pull/321

I think this issue can be closed now? Last I checked this was working as intended.

I think this issue can be closed now? Last I checked this was working as intended.

For me, it still doesn't work with Jedi and Python 3.7 (It does work when I switch to Python 3.6.6, for some reason)

@egabrum I think that's a jedi issue?

@j9ac9k Possibly. Is there a way to figure out whether it is purely a Jedi problem, or the interaction with VSCode, or the version that VSCode uses?

Use another code editor that uses jedi for auto completion and see if you
get the same behavior.
On Fri, May 3, 2019 at 8:28 PM egabrum<EMAIL_ADDRESS>wrote:

@j9ac9k https://github.com/j9ac9k Possibly. Is there a way to figure
out whether it is purely a Jedi problem, or the interaction with VSCode, or
the version that VSCode uses?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/Microsoft/vscode-python/issues/2446#issuecomment-489289717,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAE5Z7RYMWOKMF4REP3BJCDPTT7GDANCNFSM4FRQNJJA
.

@j9ac9k thanks for validating the fix!
@egabrum you can check if Jedi works as expected by setting "python.jediEnabled": true. If it doesn't work you can open a separate issue (on us or Jedi itself).


New/whitelist

A simple whitelist of addresses for basic access control

I've realized this is 90% the same as openzeppelin's Roles.sol. Leave it open for a little bit longer while I do some work, and then probably it will be removed.

successfully as seen here https://travis-ci.org/HQ20/contracts/builds/623190161?utm_source=github_status&utm_medium=notification
I will merge.


GPU training is slower than CPU

I bought new GPU with GTX 1060 6GB. Set Nd4jBeckend as CUDA 8.0. I downloaded NVidia CUDA Toolkit 8.0 and patch 2 and both installed.
I set GPU memory limit 6GB.
I start training my neural network (I use dl4j 0.91) and I see it is slow. It is slower almost two times than CPU training.
GPU average load is 1-3 %. It is not training - it is only screen showing !!!
CPU load is 50-85%. In CPU training was 97-100%.
GPU memory usage is 2-3 GB.
My data is not big. I guess tents MB.
I use those commands:
logger.info("Nd4jBackend.BACKEND_PRIORITY_CPU: {}", Nd4jBackend.BACKEND_PRIORITY_CPU);
logger.info("Nd4jBackend.BACKEND_PRIORITY_GPU: {}", Nd4jBackend.BACKEND_PRIORITY_GPU);
//
logger.info("Nd4j.getBackend(): {}", Nd4j.getBackend().getClass().getSimpleName());
logger.info("getBackend.getPriority(): {}", Nd4j.getBackend().getPriority());
Console shows:
c.vhr.bac.BAC36 - Nd4jBackend.BACKEND_PRIORITY_CPU: 0
c.vhr.bac.BAC36 - Nd4jBackend.BACKEND_PRIORITY_GPU: 100
o.n.l.f.Nd4jBackend - Loaded [JCublasBackend] backend
o.r.Reflections - Reflections took 587 ms to scan 388 urls, producing 128519 keys and 140910 values
o.n.n.NativeOpsHolder - Number of threads used for NativeOps: 32
o.r.Reflections - Reflections took 115 ms to scan 19 urls, producing 31 keys and 227 values
o.n.l.a.o.e.DefaultOpExecutioner - Backend used: [CUDA]; OS: [Windows 10]
o.n.l.a.o.e.DefaultOpExecutioner - Cores: [8]; Memory: [3,6GB];
o.n.l.a.o.e.DefaultOpExecutioner - Blas vendor: [CUBLAS]
o.n.l.j.o.e.CudaExecutioner - Device name: [GeForce GTX 1060 6GB]; CC: [6.1]; Total/free memory: [6442450944]
c.vhr.bac.BAC36 - Nd4j.getBackend(): JCublasBackend
c.vhr.bac.BAC36 - getBackend.getPriority(): 100
I don't see error. Could you help me?
Thank you

GPUs are not always going to be faster, especially for small amounts of data. Try to increase at least the batch size to as large a value as you can.

But GPU doesn't do any mathematic operations for training. It is not OK.

No miracles out there. GPU is used, but your data is probably tiny and your OS is probably windows. So data transfers and kernels execution price is never payed back.

What is input features shape?

Can i see NN config in java?
Input features shape is exactly what i've said: you send some INDArray as input features to your nn. So i wonder what's the shape of that features array.
If you use CUDA backend, you're guaranteed to use CUDA for all math in 0.9.1. On current master it's not simple atm, but for 0.9.1 that's guaranteed.

ad 1. I have something like Arbitr and set NN config using ParametrSpace class. Do you want it?
CPU training works OK.
ad 2. I use DataSetIterators for MLN.pretrain and MLN.fit
My data are time series and are normalized to range 0-1.
It is 18667 rows and 325 columns. How send it?
ad 3. I use dl4j from jars (maven repozitories). All is 0.9.1.

yes please. anything that's human readable should work for me.
18667 rows - that's total number of examples you have? and what's your batch size?
ok.

Here is: https://gist.github.com/clavvis/c69d3fd99497c592f522a6fcaaccb217
Data has 10 batches. Last version was "only" 18660 rows per 1866 row in batch.

Hm. Thats suspicious.
Can you please attach PerformanceListener to your model, and provide me with its output?

I have my stats. https://gist.github.com/clavvis/7cc2ad1e6a43198249907f1eb63bd46a
Traininig (pretrain include) start at 20:22:17. I stopped it at 07:29:36 next day. It was too slow.
Every epoch is 10 batches. Maybe it could be enough information.

You were asked for the PerformanceListener Output, as it contains more information than just how long the overall thing takes.
In cases like yours it isn't unusual that just creating the next DataSet object takes long enough that the GPU sits around twiddling its proverbial thumbs, while it waits for more data to arrive.
The PerformanceListener output will tell you how long it takes to do exactly that.

Exactly. I’ve asked for PerformanceListener output because of its ability to show ETL and training time separately.

I can do it. But standard proces take about 15 hours. Can I use smaller epochs count?

i just need to see output for 10-20-30 iterations. No need for full training cycle :)

I use custom MLN = child of MLN https://gist.github.com/clavvis/b1a1a7e02e569280fb2775d9cd1edba5
Because standard MLN (0.9.1) do in fit(DataSetIterator) in one epoch pretrain and training too.
I hope it is not source og GPU problem.

Here are results for one training MLN: https://gist.github.com/clavvis/263a013ed478e3df813458d2c0a897ef

Here are results for 3 MLN training at one time: https://gist.github.com/clavvis/edefd5ad533af7e6b543fb2df1309769

You have very big time variance there. It shouldn’t be like that.

Here is my DataProvider and DataSetItrator. https://gist.github.com/clavvis/dbf8a8b3d50ee5785dcf8f7721ad803c

You have very big time variance there. It shouldn’t be like that.

Looking at the results for the single and 3-network execution: These spikes look at first glance a lot like garbage collector (GC) pauses due to huge number of objects in JVM.
@clavvis Can you run this with a profiler attached? Yourkit or visualvm. I'd like to see 2 things:
(a) Total number of objects in the JVM during execution
(b) The GC activity/pauses
And make sure you are using workspaces and GC configuration as per here: https://deeplearning4j.org/workspaces

First I did some fast tests. Settings: 50 epochs pretrain  and 100 epoch training. 10 batches.

duration 8.29 minute - big iterations duration variances

add command:  Nd4j.getMemoryManager().setAutoGcWindow(5000);
duration 2.51 minute - big it. dur. variances

GC command changed to: Nd4j.getMemoryManager().togglePeriodicGc(false);
duration 2.00 minute - smaller it. dur. variances, but still distinctive

1 batch
duration 1.51 minute - small iterations (=epoch now)  duration variances
iteration duration  is 680-714 ms (38x) and other are 563, 935 and 779 ms

2 batches
duration 1.55 minute - iterations duration is 51, 620, 53, 618 and further similar

Please always post PerformanceListener results. We're able to interpret them :)

Had you enabled workspaces?

Training and inference Workspacemode is set to SEPARATE. P.lister results I added.

Get any java profiler tool (ie JVisualVm or YourKit profiler) and make screenshot of GC tab please.

p.s. it definitely looks like GC problem.

With 1 batch or with another batches count? What should be GC settings?

@clavvis for the GC window output, let it run for a bunch of batches... doing training for a few minutes should be enough. As for GC setting - doesn't matter too much - but say run with every 5 seconds (default, or every 10 seconds would also be ok), just mention what settings you used.

It is for 10 batches and GC every 5 sec.

OK, so that's a bit less useful than I had hoped... still, it confirms that there's significant GC activity.
Assuming I'm reading this correctly - note the 190 total collections, 34.9 sec... 25 old gen collections, 31.1 sec
So it's mostly old gen. And it suggests there's a lot of long-lived objects - which is known to cause long GC pauses.
So in my mind, the only remaining questions here are:
(a) how many objects?
(b) what are the objects?
To answer both questions, check visualvm: Applications -> Heap dump -> Objects (drop-down)

I have way more simple question. Is that our code used for everything? I.e. Arbiter + DataVec + DL4j, or there's someone else's code as well in the middle?

First named items are my data.

Yes

For "deleting" all useless objects should I set null all objects, or is enough set null only "super" objects (arrays, lists)?

It's not that easy.  There are ways to get around that obviously, but that has nothing to do with nullified objects etc

I have super object useful, but some inside object useless. I set some null; Now it look better.

Yeah, 6.5 million Double objects - that's definitely certainly the cause here.
That'll cause bad GC performance and long pauses it any Java code - though ND4J will be a more prone to it due to (much decreased with workspaces) reliance on GC for off-heap memory.
Millions of Double objects points to bad design, IMO - both in terms of memory and performance.
I'm assuming it's coming from List and similar? If so, I'd suggest using double[], INDArray or something like Eclipse collections DoubleArrayList - https://github.com/eclipse/eclipse-collections/blob/master/docs/guide.md#primitive-lists
Beyond that, tuning GC frequency and using workspaces will help, but fixing the underlying design issue will be a much better solution.
As the GC pressure isn't due to our code - I'm closing this issue.

Thanks for help.


EnableReferences() requires public empty ctor even with EnableParameterizedContent() extension

Take the following class:
public class Person
{
    public Person(string name)
    {
        Name = name;
    }

    public string Name {get; set;}

    public Person Mother {get; set;}

    public Person Father {get; set;}
}

When attempting:
using (var xmlWriter = XmlWriter.Create(path, new XmlWriterSettings { Indent = true }))
{
    var serializer = new ConfigurationContainer().EnableParameterizedContent().EnableReferences().Create();
    serializer.Serialize(xmlWriter, person);
}

This will fail with The serializer for type 'TaskSequencer.Actions.RunCommandAction' could not be found.  Please ensure that the type is a valid type can be activated.  The default behavior requires an empty public constructor on the (non-abstract) class to activate.
This works when Person has an public empty ctor, but not when one isn't present (regardless of whether EnableParameterizedContent() is present or not).

Very close here.  We follow the protobuf rules as outlined here.  This requires that all arguments are read-only and match the same name as their properties.
With the following class:
https://github.com/wojtpl2/ExtendedXmlSerializer/blob/e3c45917b49cd595012c6da80dae62441e3e4cf0/test/ExtendedXmlSerializer.Tests/ReportedIssues/Issue203Tests.cs#L22-L31
The code emits and passes as expected.
It does look like you've seen #196 which will allow you to modify the specification used here to enable your scenario.  Please feel free to look further into that code there and let me know if you have any further questions.

Dope! Yeah ... guess sometimes you just need to take a step back and look at it from a different angle. I was so sure that the problem was coming from EnableReferences() that I never even contemplated the fact that it was because the property referenced in the ctor had a public setter ... sigh... let me test this out when I get to the office tomorrow and I'll close this issue if it works.

Ok, this can be closed as the issue was completely different than the one advertised and as you said it's intended.


throw errors when adding a listener that is not a function

I feel a little like this is an over caution, and for such a hot path, this is a big performance hit... im on the fence about putting this in.

Is emitter.on a hot path? I could see how emitter.emit is a hot path, but .on is something you call at most a few times (or at least only at certain checkpoints)
Also node's EventEmitter does throw an error
$node

var ee2 = new (require('eventemitter2').EventEmitter2)();
var ee = new (require('events').EventEmitter)();
ee.on('test', null)
Error: addListener only takes instances of Function
at EventEmitter. (events.js:94:11)
at [object Context]:1:4
at Interface. (repl.js:179:22)
at Interface.emit (events.js:64:17)
at Interface._onLine (readline.js:153:10)
at Interface._line (readline.js:408:8)
at Interface._ttyWrite (readline.js:585:14)
at ReadStream. (readline.js:73:12)
at ReadStream.emit (events.js:81:20)
at ReadStream._emitKey (tty_posix.js:307:10)
ee2.on('test', null)

The fix came because a developer accidentally added a null object to an emitter and we had to track down why on earth were we not receiving and emit even after registering one
var listener;
... some buggy code with an if to set the appropriate listener
ee2.on('myevent', listener)
... some place else
ee2.emit('myevent', {stuff:1})

actually. since im not trying to push this into core anymore, might as well pull it in.

thanks for the merge!


Entity enums: are not being correctly sorted by position

To fix: entity-enum.js, change:
.sortBy(o => [o.definition.position, o.definition.id])
to
.sortBy(["definition.position", "definition.id"])

Thanks, we'll pop it in the next release


Add type-specific Clipboard methods

@justinmc As discussed in #60145...
Based on iOS 14's new UIPasteboard APIs, we need to add type-specific methods to Flutter's Clipboard utility:

Clipboard.getImages
Used most commonly in chat apps. Should implement UIPasteboard and hasImages. (Docs)
Clipboard.getNumbers
Used most commonly for auto-verifications. Should implement UIPasteboard and detectPatterns. (Docs)
Clipboard.getStrings
Used most commonly in journaling/editing apps. Should implement UIPasteboard and hasStrings. (Docs)
Clipboard.getUrls
Used most commonly for deep-linking and auto-population of URLs. Should implement UIPasteboard and hasURLs. (Docs)

Thanks for creating this!

@justinmc Is this still open? I know #60145 was resolved a while back...

This needs to be revisited!
Starting iOS 16 a system alert is produced whenever an app tries to access the clipboard data asking the user for their consent. Typically, developers will just get the clipboard data and then parse it to see if it's the type they are looking for.
However now, the developers cannot afford to do that as it will produce a new alert each time even if the user does not have a relevant clipboard type to what we are looking for.
For example, in Swift, we would normally use the Pasteboard API, if the app is trying to get just images it cause use something like this:
let pb: Data? = UIPasteboard.general.data(forPasteboardType: "public.image")
This will return null if the user has something that's not an image (like text), and will not try to fetch the clipboard content evoking a system alert.

@SethuSenthil It's only been 2 years. Give it time. 😜

I see that hasStrings is already implemented, so I guess it wouldn't be hard to implement the hasUrls/hasImage etc?
  /// Returns a future that resolves to true iff the clipboard contains string
  /// data.
  ///
  /// See also:
  ///   * [The iOS hasStrings method](https://developer.apple.com/documentation/uikit/uipasteboard/1829416-hasstrings?language=objc).
  static Future<bool> hasStrings() async {
    final Map<String, dynamic>? result = await SystemChannels.platform.invokeMethod(
      'Clipboard.hasStrings',
      Clipboard.kTextPlain,
    );
    if (result == null) {
      return false;
    }
    return result['value'] as bool;
  }

@justinmc If you're too busy, I'd love to help out with a PR fixing this. A few directions could help me get started. I see you already implemented the hasStrings method

Adjusting team assignment; while there are iOS-specific aspects here, the overall type-specific clipboard API design should be cross-platform.

Somewhat related: PR https://github.com/flutter/flutter/pull/110052 did image insertion via the keyboard on Android (not the clipboard).

@simplenotezy Sorry I missed your comment, but if you're still up for it I'd be happy to help you fix this!


Love it

Which versions of Atom does this support?

By "this" you probably meant these DuoTone themes?
They should work with the current Atom version 1.12. And probably also a few versions back.

Yes, I did mean the DuoThemes. I don't know what I did, I was just using
the comment button on your website. I saw that it was starting a new issue.
I thought that's how you wanted it?
On Tue, Dec 20, 2016 at 6:12 PM, simurai<EMAIL_ADDRESS>wrote:

By "this" you probably meant these DuoTone themes
http://simurai.com/projects/2016/01/01/duotone-themes?
They should work with the current Atom version 1.12. And probably also a
few versions back.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/simurai/simurai.github.io/issues/8#issuecomment-268415145,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AEArAqECLXUHGRBeF6gIF9Ysm73ajuQvks5rKIsUgaJpZM4LRL_j
.

Yeah, using GitHub issues as comments is kinda experimental. 😬
It probably should pre-populate the title, like [Feedback] Title of the blog post. Will try to add that.. one day ™.

I thought it was novel considering you're employed by github and leveraging
the technology and resources that you already are a part of! Kudos
On Tue, Dec 20, 2016 at 7:50 PM, simurai<EMAIL_ADDRESS>wrote:

Yeah, using GitHub issues as comments is kinda experimental. 😬
It probably should pre-populate the title, like [Feedback] Title of the
blog post. Will try to add that.. one day ™.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/simurai/simurai.github.io/issues/8#issuecomment-268428717,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AEArAqPo6jiJ6UwBCRGpYLKxK0bXkq_Bks5rKKIbgaJpZM4LRL_j
.


Escrow UX Flow improvement

Currently managing multiple escrows in which you may have varying role is confusing because buyer/seller/arbiter all see the same 3 enabled options when right clicking an escrow- complete escrow, release escrow, and refund escrow. Also replicated in buttons along the bottom of the wallet frame.
This enhancement would remove the buttons along the bottom of the escrow panel, and the right click menu. A single button on the bottom would replace the existing refund/release/complete buttons that says "Manage Escrow". Right click menu would also be updated as such, and double clicking on the escrow row would automatically open the Manage Escrow dialog.
Manage escrow dialog presents  series of buttons dependent on your role in the escrow transaction.
Buyer: Release Escrow
Arbiter: Release Escrow, Refund Escrow
Seller: Complete Escrow, Refund Escrow

when a buyer gets refunded he needs to also take action and claim his refund.. so right now he clicks release escrow to release his coins once its refunded. I think its a bit more complex than this.

In the new flow, there are 10 states you need to test(all states have custom messages):
If escrow is activated:

buyer can releas
seller can refund
arbiter can release or refund

If escrow is released to seller:
4) Buyer cant do anything
5) Seller can claim payment
6) Arbiter cant do anything (receives commission on claim if he did the release)
If escrow is refunded:
7) Buyer can claim refund
8) Seller cant do anything
9) Arbiter cant do anything (receives commission on claim if he did the refund)
If escrow is complete:
10) Buyer/Seller/Arbiter cant do anything.

please test and close

Tested and verified.