Doc Issues - Blue-Green Data Encryption Key Rotation

Is your suggestion related to a missing or misleading document? Please describe.
Document link: https://is.docs.wso2.com/en/5.12.0/administer/blue-green-data-encryption-keyrotation/
User guide : https://docs.google.com/document/d/14rWfFLZqfgwSh9qAnwY1hEwX8V-cIQGm-rqH6PIfRP0/edit?usp=sharing

[ ]  Location refers to the <KEY_ROTATION_REPO>  is corrupted.  https://github.com/wso2/identity-tools/tree/master/components/org.wso2.carbon.identity.keyrotation

[ ] Let's break down 3rd point for more clear the configurations. Add path to file properties.yaml and keyrotation.sh.

[ ]  Content is not visible once expand these drop downs

[ ] Shall we add the diagrams explain the process of this feature which available on email thread , Key Rotation Tool Configuration Encryption Keys/Run Time Data Encryption

[ ] No link available for the "here" phrases.

[ ] Better to add information regarding Configurations Related to Symmetric Key Encryption(https://is.docs.wso2.com/en/latest/administer/using-symmetric-encryption/#configurations-related-to-symmetric-key-encryption). This will help to update the properties.yaml file in <KEY_ROTATION_TOOL.

[ ]  Shall we add more details in verification section

"Check log file" --> shall we mention which log files

"7 identity and registry database tables" --> Shall we mention the tables

"Check the log files to verify if transformation of the synced data happened successfully for the 4 tables."  --> Shall we mention the which tables are

Describe the improvement

Optional Fields
Additional context

Related Issues:

This issue is being closed due to extended inactivity. Please feel free to reopen it if further attention is needed. Thank you for helping us keep the issue list relevant and focused!


Asset Manager does not load Sounds in nested subdirectories from the assets folder.

Issue details
Problem loading sounds in nested paths using Assets Manager resulting in FileNotFoundException.
Reproduction steps/code

Create a libgdx android project using the guide
Create the following folder tree in assets folder
assets/path1/path2/path3
Place the sound file in the path3 directory
Load the sound file using Assets Manager

Version of LibGDX and/or relevant dependencies
1.9.11
1.9.13
Please select the affected platforms

[X] Android

Does the same occur without using AssetManager (e.g. Gdx.audio.newSound(Gdx.files.internal("path1/path2/path3/sound.ogg")))

Does the same occur without using AssetManager (e.g. Gdx.audio.newSound(Gdx.files.internal("path1/path2/path3/sound.ogg")))

I'm sorry, the code base is huge, I cannot run this test. you can try this in your project maybe.

You can easily just put this code in a new launcher to test. You don't need to run within your codebase.
Please see https://github.com/libgdx/libgdx/wiki/Getting-Help, your report does not contain enough info for it to be suitable on the tracker. There are no logs, reproduction steps are not complete and you have already shot away someone that has asked you to test trivial code to diagnose you issue.
Please feel free to reopen when the info as requested in the link and issue template have been fulfilled.

Just tested it and can't reproduce.


213 develop popup component

@TheHadiAhmadi what is the usage for Popup component? There is no documentation.

@pournasserian we are using it internally and user doesn't need to use it directly.
Do you know any usage other than Popover, tooltip and drop-down menu?

@TheHadiAhmadi got it.
In Popover component, I prefer to have a show boolean prop rather than using component sibling. What do you think?

@TheHadiAhmadi got it. In Popover component, I prefer to have a show boolean prop rather than using component sibling. What do you think?

Similar to Modal, Offcanvas, etc.

What if we support both use cases?
We need to have target element (for calculating placement) and to manage open/close states we can have trigger property (hover, focus,click) and also show boolean property

@pournasserian What if we support both use cases? We need to have target element (for calculating placement). to manage open/close states we can have trigger property (hover, focus,click) and also show boolean property

Got it. That's fine for now.


DNS update for getting public IP for api.jiocloudservices.com

Override for dnsmasq in compute nodes to ensure dnsmasq does not server request from /etc/hosts file in compute nodes

please test this


zsh: exec format error: j2objc

When I try to run the command j2objc Hello.java I'm getting the following error:
zsh: exec format error: j2objc
here is my java --version output:
openjdk <IP_ADDRESS> 2020-11-04
OpenJDK Runtime Environment AdoptOpenJDK (build <IP_ADDRESS>+1)
OpenJDK 64-Bit Server VM AdoptOpenJDK (build <IP_ADDRESS>+1, mixed mode)
what am I misssing here?

This works for me using zsh with OpenJDK 11. Since the "exec" in this error message is short for "executable", check the following:

Is the j2objc script executable? Run ls -l ~/j2objc-2.7/j2objc (or whatever the path is to your copy of the j2objc script) and you should see something like -rwxr-xr-x, with the x's showing it is executable. If there aren't x's, then delete your j2objc distribution and unzip the latest version.
Is Java configured on your system correctly? Run which java to see what binary zsh executes, then run echo $JAVA_HOME and verify it points to the same JDK path from where java executes.
If you don't have JAVA_HOME set in your environment, run /usr/libexec/java_home -v 1.8. That command searches for the latest version of Java 1.8 installed on your Mac, and is what the j2objc script calls if JAVA_HOME isn't set. Verify the path returned by java_home can run with the -version flag.

This works for me using zsh with OpenJDK 11. Since the "exec" in this error message is short for "executable", check the following:

Is the j2objc script executable? Run ls -l ~/j2objc-2.7/j2objc (or whatever the path is to your copy of the j2objc script) and you should see something like -rwxr-xr-x, with the x's showing it is executable. If there aren't x's, then delete your j2objc distribution and unzip the latest version.
Is Java configured on your system correctly? Run which java to see what binary zsh executes, then run echo $JAVA_HOME and verify it points to the same JDK path from where java executes.
If you don't have JAVA_HOME set in your environment, run /usr/libexec/java_home -v 1.8. That command searches for the latest version of Java 1.8 installed on your Mac, and is what the j2objc script calls if JAVA_HOME isn't set. Verify the path returned by java_home can run with the -version flag.

I am Downloading TLauncher for Minecraft in Kali Linux but I am having that error:
zsh: exec format error: ./TLauncher-2.895.jar
Can someone please help me with this error.

"TLauncher-2.895.jar" has nothing to do with j2objc, so we can't help you. Since it's a Java jar file, you might want to search for an answer on StackOverflow.com.

OK thanks


:wrench: add the ability to not show a subtitle for content placehold…

Simple change to give the heading an option to not show its subtitle.

@michalsnik, not sure how to assign this to you.

closing since it vue2 is out the door.


work with dynamic multi tenant databases

This is proposal to get working with multiple tenant databases under one Repo. Despite of fact that ecto_sql seems to have only one repo.all callback I've used here put_dynamic_repo helper function from https://github.com/elixir-ecto/ecto/pull/2947 to avoid writing extra repo code or modifying repo functions to pass extra :name arg just to find right tenant db repo process. The idea is to add :name argument to Ecto.Migrator.run if my Repo has linked multiple tenant databases and iterate migrations trough all defined names. For now I've modified only one test to check this proof of concept.

This looks great to me! I would only rename the option to :repo_name for
clarity.
José Valim
www.plataformatec.com.br
Skype: jv.ptec
Founder and Director of R&D

:heart: :green_heart: :blue_heart: :yellow_heart: :purple_heart:


Updates to Python docs

Fixing https://github.com/microsoft/kiota/issues/2326

There are a couple of comments from the customer still yet to fix.

Hello @samwelkanda, please take a look at the changes I made to address the customer's comments in the issue 2326.


Remove lib folder from gruntConfig watch.

We no longer use a lib folder. Or is this for Volo support @kevinparkerson? Is there any problem with removing it from the watch task?

Fixed by #1124.


[BUG] Error when series filter value is empty

Hits count() error when series > filter > value is empty.
Example of written code -
               ->series(array([                     'label' => 'Test',                     'filter' => [                         'key' => 'column',                         'operator' => 'IS NULL'                     ],                 ],
Error got in DevTools network -
exception: "ErrorException"  file: "D:\path\vendor\coroowicaksono\chart-js-integration\src\api\TotalRecordsController.php"  line: 56 message: "count(): Parameter must be an array or an object that implements Countable"
Working with -

Laravel Version: v5.8

Nova Version: v2

Nova-ChartJS Version: v0.3.2

OS: Window 10

Browser: Chrome

Version: 87

@coroo any comments on this issue? there is a PR ready on this (#79)

@coroo any comments on this issue? there is a PR ready on this (#79)

Sorry for too late response since I'm not focus in this one again.


Repository link in Cargo.toml is broken

The repository link for the Cargo.toml configuration of corepc-node is broken.

See #16 for a related issue.


Replace broken .envrc with a working shell

Adds a working direnv config for hacking on cargo2nix itself

Very handy! Thanks, @workflow. Is there some way you can have the shell.nix pull in the shell attribute from the default.nix instead of calling mkShell yourself? That attribute should contain all the things necessary to iterate on cargo2nix locally, including Rust, pinned system dependencies, etc.
If there doesn't seem to be a way, then perhaps we can approve this PR as is.

Certainly can :)


V3/collection re fix

Looks like the Regex::searchAll() method is not case insensitive (InMemoryPerProcess::resolveSingleMatch() needs that). This bug detected with help of CRS regression test 920450.
Also fix (temporary) the 'ovector' limit bug, which triggered when the regex contains too much brackets, eg. in CRS rule 942130.

Could somebody re-run the CI build? Looks like it was failed (by Travis):
InstalledDir: /Applications/Xcode-9.4.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin
before_script.1
0.06s$ echo $TRAVIS_OS_NAME
osx
$ [ "$TRAVIS_OS_NAME" != osx ] || brew update
==> Downloading https://homebrew.bintray.com/bottles-portable-ruby/portable-ruby-2.3.7.mavericks.bottle.tar.gz
######################################################################## 100.0%
==> Pouring portable-ruby-2.3.7.mavericks.bottle.tar.gz
==> Homebrew is run entirely by unpaid volunteers. Please consider donating:
  https://github.com/Homebrew/brew#donations

No output has been received in the last 10m0s

Thanks :)

hey @airween, I've triggered a rebuild on the failed build. We should have the results in a moment.
Thanks for your contribution, me or @zimmerle will have a chance to review it soon :)

Merged ea937cf572dcf9ef5d964fa87dd6aca831d24d77 and 640daa49025a59aee039dfda0a1f34f137415f32. I do have something that I want to discuss about 3334d2a6b26d560ad6d8b820ee6d3fb56e327a75 and 4e1b99ad90a0cfa07bf856984c2c657e12fa2cd2.

You can make a regular expression case insensitive by prefixing it with (?i). It seems to be supported almost everywhere (I checked libpcre, Python re, RE2, Hyperscan).

Hi @WGH-, thanks, I know it - but the problem is not that.
The problem is, the comparing variables on collections (in-memory and LMDB) must be case insensitive.
This condition is not met.
See this PR, and the documentation.
BTW, the ModSec2 follows this way... so I think we have to align the ModSec3 too.

@airween as commented by @WGH- the regular expression could be handled this with the ignore case "modificator". In any case, your pull request is currently holding four commits:

80409045125387b5a5e1f405855dbf03d245d30b - Removed pcre dependency from outside of regex class
3334d2a6b26d560ad6d8b820ee6d3fb56e327a75 - Regex search in collection data case insensitive fix
4e1b99ad90a0cfa07bf856984c2c657e12fa2cd2 - Fixed regex case insensitive search bug in LMDB
640daa49025a59aee039dfda0a1f34f137415f32 - Added test cases

In<PHONE_NUMBER>5387b5a5e1f405855dbf03d245d30b you have fixed a problem added in 3334d2a6b26d560ad6d8b820ee6d3fb56e327a75 and  3334d2a6b26d560ad6d8b820ee6d3fb56e327a75. Do you mind to change 3334d2a6b26d560ad6d8b820ee6d3fb56e327a75 and 3334d2a6b26d560ad6d8b820ee6d3fb56e327a75 to actually incorporate<PHONE_NUMBER>5387b5a5e1f405855dbf03d245d30b ?

The https://github.com/SpiderLabs/ModSecurity/commit/80409045125387b5a5e1f405855dbf03d245d30b should ignore. Do I revoke it?
I know what @WGH- said and your idea, but the CRS contains regex's without modifications, and modsec2 works with it. I'ld like to follow that way, tha's why I sent this PR.
The other solution would be that all occurrences of necessary regex's need to add the modifier, and works of libmodsec3 should differ from ModSec2.

Closed this PR, and re-opened a new one here: #2107


Package request: gosu-lang

Gosu is a JVM based programming language

Gosu is a pragmatic programming language for the JVM. It has been designed with Java developers in mind by providing a set of features that allow them to be more productive without sacrificing the benefits of Java's simple syntax and type-safety. Gosu is an object oriented language with a sprinkle of functional programming features.

Metadata

homepage URL: https://gosu-lang.github.io/
source URL: https://github.com/gosu-lang/gosu-lang
license:  Apache-2.0 license
platforms: JVM

Last updated 5 years ago. Is there a significant need that justifies including this (which is frankly just abandonware)?


Request Help～

hello~
I want to ask if you can add a showcase of the following table classes (such as Line chart)?
Thanks.

@Omooo, you are right, there are no chart libraries in kotlin-wrappers.
Probably you should pick a library that you need and write Kotlin declarations yourself. I recommend this one - Tanstack React Charts. It is very useful and also there are a bunch of other Tanstack libraries in Kotlin Wrappers such as

Tanstack Query - kotlin-tanstack-react-query
Tanstack React Table - kotlin-tanstack-react-table
Tanstack React Virtual - kotlin-tanstack-react-virtual

For information about how to create Kotlin declarations for JS libraries, you can write here to the corresponding Slack channel - "kotlinlang #react"
P.S. I hope that someone who wants to collect all libraries from Tanstack will help you


platform architecture dependency arm64 missing

I'm trying to use this module on an NVIDIA Tegra system  with an arm64 architecture but arm64 is not listed in the supported arch parameter in the package.json.
I manually changed it and it does work, so can you add arm64 to the main repository?

@hsgreen Done! 👍

Looks like the fix 2148adac5683c80a24921845f0e16e5cdbc152be was not pushed to the main NPM repository for validate-ip-node.


Fix inventory_to_container - incorrect parameter in get_devices

inventory_to-container module uses an incorrect parameter to call get_device function for a specific scenario
No execution error has been reported yet, but should be fixed to protect unexpected situation.
// get_device definition
def get_devices(dict_inventory, search_container=None, devices=None)

// get_device call:
# Extract sub-group information
for k2, v2 in v1.items():
    get_devices(
        dict_inventory=v2,
        search_container=search_container,
        devcices=devices
    )

Commit should be cherry-picked to releases/v1.0.x

Will be fixed in releases/v1.0.x


Parquet uploads off-by-one naming scheme

Describe the bug
I noticed this numbering scheme not matching up in a different project and wanted to raise it as an issue for discussion, what is the actual proper way to have these stored?

The -SSSSS-of-NNNNN seems to be used widely across the codebase. The section that creates the part in my screenshot is here https://github.com/huggingface/datasets/blob/main/src/datasets/arrow_dataset.py#L5287
There are also some edits to this section in the single commit branch.
Steps to reproduce the bug

Upload a dataset that requires at least two parquet files in it
Observe the naming scheme

Expected behavior
The couple options here are of course 1. keeping it as is
2. Starting the index at 1:
train-00001-of-00002-{hash}.parquet
train-00002-of-00002-{hash}.parquet
3. My preferred option (which would solve my specific issue), dropping the total entirely:
train-00000-{hash}.parquet
train-00001-{hash}.parquet
This also solves an issue that will occur with an append variable for push_to_hub (see https://github.com/huggingface/datasets/issues/6290) where as you add a new parquet file, you need to rename everything in the repo as well.
However, I know there are parts of the repo that use 0 as the starting file or may require the total, so raising the question for discussion.
Environment info

datasets version: 2.14.6.dev0
Platform: macOS-14.0-arm64-arm-64bit
Python version: 3.10.12
Huggingface_hub version: 0.18.0
PyArrow version: 12.0.1
Pandas version: 1.5.3

You can find the reasoning behind this naming scheme here.
This point has been raised several times, so I'd be okay with starting with 00001- (also to be consistent with the transformers sharding), but I'm not sure @lhoestq agrees.

We start at 0 in datasets for consistency with Apache Spark, Apache Beam, Dask and others.
Also note transformers isn't a good reference on this topic. I talked with the maintainers when they added shards but it was already released this way. Though we found that there is a backward-compatible way in transformers to start at 0, but no request from transformers users to changes this AFAIK.

Makes sense to start at 0 for plenty of good reasons so I'm on board.
What about the second part -of-0000X? With single commit PR #6269  just getting merged, there was a note about issues with 100+ file edits https://github.com/huggingface/datasets/pull/6269#issuecomment-1755428581.
That would be my last remaining concern in the context of the push_to_hub(..., append=True) work to be done, where appending a single file to the full dataset will require renaming every other existing file in the dataset.


[comments] auto expand comments sidebar when clicking on highlighted text

not gonna worry about this given deck reorg,


[URI4Files] Add CA certs to all Core/Support/Secuiry docker images so pulling file via HTTPS is enabled

All service docker files will need the standard ca certs added to enable use of https calls to external server
See example here

Not needed.


Minor improvements in fock_prob()

Some minor improvements to fock_prob() that should make the code a bit more readable and which, in test runs with cProfile, reduce the average run-time of the unite tests of the gaussian backend by a few percent (for larger systems the difference should be more substantial). Hope you find these useful!

Looks good!
Perhaps @nquesada could have a look over the change, especially the rounding of Amat - if I recall, the rounding was intentional to prevent an edge case bug where numerical precision affected the symmetry of Amat?

If that's the case, then maybe it would be a good idea to add a test that fails when the rounding is removed. Anyway, the (minor) performance improvement comes from not inverting a matrix twice. Sorry for failing to add spaces around ==.


feature/#139 - new home page with preview and direct access to all the features

New file:

home_page.dart: new home page with preview and direct access to all the features

Impacted files:

choose_page.dart: made public the method to perform http search; limited the widget to the categories; simplified
dao_product_list.dart: added and edited methods to get only the first items (optimization in mind)
list_page.dart: added title and typeFilter as parameters, which has a minor impact on the code
main.dart: moved the widget part to new class HomePage
profile_page.dart: added an AppBar; minor refactoring

@M123-dev Thank you for your comment!
The added value of displaying the actions as lists is that - as @stephanegigandet pointed out - the end-user can relate to their lists, their scans and their products, instead of just an icon and a label. And with that home page you have an immediate view on all you can do, cf. the onboarding.
I'm not against evolutions like a BottomNavigationBar, but we should put there only things that are relevant enough to be displayed in the home page, and without added value when displayed in a list.
In whatsapp and Evernote there's no BottomNavigationBar in the "home page" (chat list in whatsapp - they use tabs on top, note list in evernote - they use a hamburger menu). In Podcast Addict they don't use a BottomNavigationBar either, they just list either broadcasts or episodes, and display in the bottom the currently playing or latest episode, with a call to action (play/pause). And in the standard SMS sending app on my smartphone there's no BottomNavigationBar either, just the list of my previous messages and a FloatingActionButton to create a new message. Therefore in my own experience it's rather common not to use BottomNavigationBar when there's no relevant contextual action.

Of course there are apps for which it is not worth having a navigation bar.
My point of view is this:
But this app is a bit diferent, we have a few different use cases:

Compare products in the store.
Several different uses with lists
and track

I don't count Contribute as a "relevant" point, because the best help happens passively.
So there are two "relevant" pages + the scanner. If we add the homepage, there are three. One can certainly be found for the symmetry later.
But if we now put everything on one page, the scope of functions seems much smaller and if you only open the app once to look up one thing you first have to check where the appropriate button is on the start page.
In my opinion, it would be better if the start page offered more of an overview. Like widgets

You ate so many calories today.
Would you like to help us translate?
This is your scan history.
Of course, the points lead you to the appropriate side. But are not the main navigation.

@M123-dev We already had @stephanegigandet and I a similar discussion in #139, from which came the following reflections:

there are 4 target modes ("choose", "organize", "track", "contribute")
all these modes share basically the same core (data + code)
but I seriously doubt that the 4 targets can fit in the same app - I find it much too confusing for the end-user (and for me too)
therefore we agreed to start with only the "choose" mode - which gives us a comparison with the current Android app
from this "choose" mode, we gradually enrich the core, get better in flutter and implement new features for the end-user
eventually, one day we manage to fit all the modes into a single app - and if we don't, we create several apps with different modes but the same core

Currently there's nothing the app does that cannot be reached in one click from the home page.

Okay, that's understandable. I hope that we manage to integrate everything properly.
Should the app be published with just the "choose" feature?
Thanks to you, the list function is already quite far and if the speed of development continues so quickly. I am sure that we can still achieve a lot this year. See roadmap for 2021 in the wiki.

Thank you @stephanegigandet!
Of course there's room for display improvements and new features.


Background color of _overlay for Menu not working on android

Description
The pseudo prop _overlay for the native-base menu is supposed to allow me to configure the background overlay when the menu is opened. I set a custom color for it but it's only working on iOS, the color is not applied on android. As a matter of fact, there is not even a default overlay color on android, it seems that this is broken?
CodeSandbox/Snack link
<EMAIL_ADDRESS>Steps to reproduce
Checkout the snack I provided, the background overlay that should be behind the menu when opened works fine on iOS (device & simulator), but it has no effect on android devices/simulator.
Even specifically adding a backgroundColor for the overlay on android does not have any effect, the overlay will still stay transparent
###Expected Behavior###
Overlay color should be the same for iOS and android
###Actual Behavior###
Overlay color only applied on iOS, it is transparent on android
NativeBase Version
3.4.25
Platform

[X] Android
[ ] CRA
[ ] Expo
[ ] iOS
[ ] Next

Hey @MarianLudwig ,
Thanks for reporting. We will look into this.


VSCode Git Synchornize Changes not work correctly

VS Code Version:  1.74.0
OS Version: Windows 11 22H2 22621.900

Steps to Reproduce:

Go to any git branch
Please click on icon on status bar - Synchornize Changes (GIT)

Icon was freeze.
Anyone was this same issue? Any help?
Thanks!

@eStasicki, sorry to hear about the issue that you are facing. Are you still able to reproduce this issue with the latest version of VS Code (1.74.2) as this is something that might have been fixed in one of our recovery releases. Thank you very much in advance!

This issue has been closed automatically because it needs more information and has not had recent activity. See also our issue reporting guidelines.
Happy Coding!


cli: fix fitconv on handling trailing commas

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 100.00%. Comparing base (7271cbc) to head (1ef4ad2).

Additional details and impacted files
@@            Coverage Diff            @@
##            master      #161   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           42        42
  Lines         3471      3471
=========================================
  Hits          3471      3471

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Deprecate apply infra + update oauth network policy

Description

This PR deprecates the existing "Apply infra" Github action in favor of the ongoing effort around Helm.
Risk

Deploy Plan

Infra changes applied.


iPhone 6 Plus (iOS 9.1) Background Mode doesn't work

Thanks for your good code.
I tried to add MyLilTimer when app comes into background mode , it doesn't seem to work.
Do you have good idea ?

Sorry for the delay in getting back to you. The timer won't wake up an iOS app in the background if it's suspended. Depending on what you're doing, there could be many approaches. Take a look at Apple's documentation on iOS Background Execution.


Example of validate_with

Hello there 😄 Thank you for contributing to Open Source. I am really enjoying using your library. I have created a function that given a String returns a Result<bool, Error> depending if a text input follows some criteria. Recently, I found that your library supports a validate_with function. Would it be easy to provide me with a usage example of validate_with?

I added a validate_with example in #41.
The general gist is:
Input::<String>::new()
    .with_prompt("Enter email")
    .validate_with(|input: &str| -> Result<(), &str> {
            if input.contains('@') {
                Ok(())
            } else {
                Err("This is not a mail address")
            }
        });

If the validate function returns Ok(()) then it is valid, otherwise it is invalid, and dialoguer will display the error.


[DO NOT MERGE] Start save location on cookie consent

⚠ This repo is Continuously Deployed: make sure you follow the guidance ⚠
DON'T MERGE - relies upon a new version of the gem with https://github.com/alphagov/govuk_publishing_components/pull/2041 first
Done and rebased
What / why
Updates the save location bank holidays experiment code so that if users consent to cookies on that page, the functionality immediately appears. Before, it wouldn't appear unless users refreshed the page, because it depended on cookie consent to work.
Visual changes
None, but you can test that it works properly by loading up the /bank-holidays page, clearing cookies and reloading. The cookie banner should be present, the save location option not. Consenting to cookies should cause the save location option to immediately appear.
Trello card: https://trello.com/c/QweAgiPc/693-bank-holidays-experiment-things-to-clean-up

Have opened https://github.com/alphagov/govuk_publishing_components/pull/2079 to try and fix the error I outlined in my earlier comment.


Update run-bamboo-plans-in-cd.md

Harness Developer Pull Request
Thanks for helping us make the Developer Hub better. The PR will be looked at
by the maintainers.
What Type of PR is This?

[ ] Issue
[ ] Feature
[ x] Maintenance/Chore

If tied to an Issue, list the Issue(s) here:

add feature flag

House Keeping
Some items to keep track of. Screen shots of changes are optional but would help the maintainers review quicker.

[ ] Tested Locally
[ ] Optional Screen Shoot.

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app

just needed the feature flag


Is there any workaround for silent auth for bots?

Hi team, is there any workaround for silent auth flow for bots?
I would like to know this is impossible by design or sample code is not ready.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: be314181-4800-4d02-cf62-fb276dc7cdd2
Version Independent ID: 259e41a3-0607-c3f8-f635-f6bce767ad2b
Content: Silent authentication and SSO - Teams
Content Source: msteams-platform/concepts/authentication/auth-silent-AAD.md
Product: msteams
GitHub Login: @o365devx
Microsoft Alias: o365devx

Currently, SSO is not available for Bots.

Thanks for the answer! :)

While it's true that SSO isn't available for bots, it's not exactly true that silent auth doesn't work for bots. It's not "as silent" as it is for tabs - you always have to log in at least once - but if your bot stores the refresh token and uses it to get a new token, it will be silent thereafter. The docs could be more clear on this point. @clearab


Cannot include logged-in user token when fetching product list

Context
There appears to be no way to pass an auth token along with a call to list products.  Because of this, the back end cannot determine which user is requesting the product list, preventing me from implementing members-only pricing or products.
e.g. this code
  const response = await spreeClient.products.list({
    include: "images",
    bearerToken: token ? token.access : undefined
  });

will not pass through the bearerToken.
Expected Behavior
The request should include the Authorize: header field, as it does with the cart operations.
Possible Fix
The API call should be updated to include the optional parameter.
Your Environment

Library version: 4.4.3
Node and yarn/npm version: node 14.15.4, npm 7.20.3

Some variant of this, perhaps?   This changes the API though.  Not sure if there's a way around that.
diff --git a/src/endpoints/Products.ts b/src/endpoints/Products.ts
index ca836e5..399ff06 100644
--- a/src/endpoints/Products.ts
+++ b/src/endpoints/Products.ts
@@ -1,14 +1,15 @@
 import Http from '../Http'
 import { IProductResult, IProductsResult } from '../interfaces/Product'
 import { IQuery } from '../interfaces/Query'
+import { IToken } from '../interfaces/Token'
 import routes from '../routes'

 export default class Products extends Http {
-  public async list(params: IQuery = {}): Promise<IProductsResult> {
-    return (await this.spreeResponse('get', routes.productsPath(), {}, params)) as IProductsResult
+  public async list(token: IToken, params: IQuery = {}): Promise<IProductsResult> {
+    return (await this.spreeResponse('get', routes.productsPath(), token, params)) as IProductsResult
   }

-  public async show(id: string, params: IQuery = {}): Promise<IProductResult> {
-    return (await this.spreeResponse('get', routes.productPath(id), {}, params)) as IProductResult
+  public async show(token: IToken, id: string, params: IQuery = {}): Promise<IProductResult> {
+    return (await this.spreeResponse('get', routes.productPath(id), token, params)) as IProductResult
   }
 }
[2684] davek@phydeaux3:((v4.5.3))~/work/instinct/dna/dna-frontend/spree-storefront-api-v2-js-sdk>git diff types/endpoints/Products.d.ts
diff --git a/types/endpoints/Products.d.ts b/types/endpoints/Products.d.ts
index 2481dd1..1c600b2 100644
--- a/types/endpoints/Products.d.ts
+++ b/types/endpoints/Products.d.ts
@@ -1,7 +1,8 @@
 import Http from '../Http';
 import { IProductResult, IProductsResult } from '../interfaces/Product';
 import { IQuery } from '../interfaces/Query';
+import { IToken } from '../interfaces/Token';
 export default class Products extends Http {
-    list(params?: IQuery): Promise<IProductsResult>;
-    show(id: string, params?: IQuery): Promise<IProductResult>;
+    list(token: IToken, params?: IQuery): Promise<IProductsResult>;
+    show(token: IToken, id: string, params?: IQuery): Promise<IProductResult>;
 }

The call would end up being
   const response = await spreeClient.products.list({
    bearerToken: token ? token.access_token : undefined
  }, {
    include: "images",
   });

applied the above patch to the fork here: https://github.com/ddombrowsky/spree-storefront-api-v2-js-sdk/tree/instinct-dna

Hey @ddombrowsky could you create a PR with these changes to this repo? :)

@damianlegawiec 👋  Do you think an optional token should be added to the stock Spree SDK? Is it a common need to send a bearer token with list and show requests? These endpoints can be extended inside the project instead. For example:
class ExtendedProducts extends endpoints.Products {
  public list(params: IQuery = {}, token?: IToken): Promise<IProductsResult> {
    return this.spreeResponse('get', routes.productsPath(), token, params)
  }

  public show(id: string, params: IQuery = {}, token?: IToken): Promise<IProductResult> {
    return this.spreeResponse('get', routes.productPath(id), token, params)
  }
}

If we're going to allows sending a token with product requests, we must make it optional.

@damianlegawiec 👋   Do you think an optional token should be added to the stock Spree SDK? Is it a common need to send a bearer token with list and show requests? These endpoints can be extended inside the project instead. For example:

class ExtendedProducts extends endpoints.Products {

  public list(params: IQuery = {}, token?: IToken): Promise<IProductsResult> {

    return this.spreeResponse('get', routes.productsPath(), token, params)

  }

  public show(id: string, params: IQuery = {}, token?: IToken): Promise<IProductResult> {

    return this.spreeResponse('get', routes.productPath(id), token, params)

  }

}

If we're going to allow sending a token with product requests, we must make it optional.

We need to add an option to send that token for all endpoints.

Hey @ddombrowsky could you create a PR with these changes to this repo? :)

PR created: https://github.com/spree/spree-storefront-api-v2-js-sdk/pull/225

https://github.com/spree/spree-storefront-api-v2-js-sdk/issues/226

We'll have to update the README too.


[Refactor] Textview

Steps:

Create a folder molecules/TextView. move TextView.tsx to this location. compile and see everything is working
Decide and implement a  refactor strategy, to make the component easier to mantain. for example:

Break component down into 4 components:

TextView (wrapper component. contain mostly logic, uses TextViewHeader and TextViewImageList components

TextViewHeader (all header view with minimal logic

TextViewImage (view with no logic)

TextViewImageList (mostly logic, TextViewImage)

@yaeluria  suggests starting this mission from branch refactor-447-textview-single-type


Introduce GlideRequestType which decides the result of image data

🎯 Goal
Introduce GlideRequestType which decides the result of image data.

#173


try to update jax and tf

/condalock

/condalock

/condalock

blocked by icu issues (or maybe grpcc/abseil migrations)


Added pngquant process

This will run pngquant against all png's in the directory, this will optimize to the level google insights wants.

Merged pngquant task


MINOR: set initial capacity for all array buffers in converting produ…

this is a bit optimization of converting producer responses. Those array buffers need initial capacity to avoid growing continually if the request carries a bunch of small messages and those messages are sent to different partitions.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

test this patch with timed profiling recording (5 minutes) and the memory usage of array reallocation is reduced from 3.14 GB to 2.81 GB


Connecting in passive Mode?

How do I connect using passive mode?

According to this comment, "PASV mode is automatically used when necessary."


Removing  browser support

We have decided to remove browser support from our docs. Some of these are not being tested, and this section could present some issues for prospective deals in progress.

Product Version(s):

Issue:

Link to docs preview:

SME review:

[ ] An SME has approved this change.

DOCS review:

[ ] A member of the docs team has approved this change.

Additional information:

Merge checklist:

[ ] Deploy preview inspected wherever changes were made
[ ] Build completed successfully
[ ] Test have passed

@tigeraphil Do you want to just scrub all mention of browsers from the support docs?


Complex Binding Issue for ManagedObject constructor with settings with curly braces

Hi,
we have experienced some issues with complex binding and passing the settings of a control via the constructor.
Passed settings to the constructor of a ManagedObject are evaluated with regards to complex bindings.
In the following example I'm passing the text for a text control which contains not closed curly braces.
new sap.m.Text({
"text" : "hello not closed curly brace {"
});
Please consider also the running code:
http://jsbin.com/zagakuxela/1/edit?html,console,output
If I set the label with the help of the function setText everything works fine.
I would expect that settings which I pass via the constructor are not evaluated with regards to complex bindings but as plain text.
OpenUI5 version:1.26.10
Browser/version (+device/version): Chrome 42 on Windows 8
What happens instead?
The following exception is thrown: Uncaught SyntaxError: no closing braces found in 'hello {' after pos:6
Best regards,
Christian

Hi Christian,
thanks for reporting this issue.
I checked our implementation and the documentation. We do interprete the constructor setting with regards to complex bindings when you set the complex binding syntax.
But if you would like to have curly brackets as text, you just need to escape them with "\".
The documentation for this can be found here:
https://openui5.hana.ondemand.com/#docs/guide/0c803921b1bf4b3a97a038fbd51ef542.html
If you adapt your example to
new sap.m.Text({
"text" : "hello \{"
}).placeAt('content');
it will work.
Kind regards,
Janina

Hi Janina,
thanks for the fast response. We didn't have the issues with handcrafted code, but with data which we got from the backend and passed as variables to the constructor. To fix the issue we are now using the setter functions instead.
By passing settings to the constructor the ManagedObject parses the attributes of the object and creates a bindingContext and binds then the property. Like in the following example:
http://jsbin.com/jaxekecole/1/edit?html,console,output
This is actually really cool, but I couldn't really find proper documentation about this behavior.
In a side sentence it is mentioned here:
https://openui5.hana.ondemand.com/#docs/guide/25ab54b0113c4914999c43d07d3b71fe.html


importing the library

Is there a guide step to step that explain how to import the library for the newbies in android studio?
thx

I am a newbie to android as well.
And I am using android studio.
I have been struggling to get this imported in my project as well.
It would be very helpfull if you provided a step by step guide for newbiews as well.
Thank you i advance :)


Optimize the inst.py for IoT platform

Make the inst.py for IoT easier to use.
No need to input the test suite name.
Support the uninstall feature.

@BruceDai, please help review it.

LGTM


ProcessService could enable to create and update process from InputStream

currently only File (regular file or directory) is supported

closing for now


Parallel test only shows one set of Pre Test and Post Test

In Aggregated view for parallel builds, we display all tests from all child jobs into one view. But it looks like we only have one set of Pre Test and Post Test. Ideally, each child job should have Pre Test and Post Test.

Haven't seen the problem for a while. Close this issue.


test on postgres 11

https://trello.com/c/dsFoxx7p/836-1-upgrade-staging-and-production-postgres-to-version-11
We will be running this on environments so should test against it.

It all worked, so I'm going to merge (Gideon and I were pairing on this)


[BUG] Performing measurements, sometimes skip Loops elements

Description
Conversation to discover bug:

Hi! I’ve noticed that while performing measurements sometimes qililab seems to skip some points. For example I was doing an experiment with two nested loops, one of 51 points and the other of 11, so I was expecting to get as a result 1122 points (taking into account both i and q). However I just got 1120. Any idea about what can be happening? With the same loops just changing the hardware average value the problem dissapears

That's weird, but since it is only skipping 1 point (i,q) the first I would think is that what is missing is the first (i,q) or the last (i,q)

Yes, it’s just missing one point, but I don’t understand why depending on the hardware average I use it happens or not

Maybe its just the typicall missing a print/return before entering the loop or something similar.
If you do a non-nested loop (only one loop), is it also missing that one point? Can you please print the length of the loops you are using? You can do so with: print(len(loop.values))

Now it’s been 2 points

Thanks! Is it the exact same experiment, printing now one less even?

Yes! Exactly the same parameters

Can you share the code? Next week someone from the team should try to replicate this bug with the instruments at Meraki such that we can fix it (edited)

Additional information
I'll imporve the bug description and add code on monday!
Source code
Hola! L’experiment que estava fent és aquest:
https://github.com/qilimanjaro-tech/HardwareDataTools/blob/bsc-working/src/hwdatatools/experiment_portfolio/two_tone.py
Amb aquest notebook:
https://github.com/qilimanjaro-tech/LabScripts/blob/main/QuantumPainHackathon/run_qubit_spectroscopy.ipynb
Però no crec que sigui només d’aquest experiment perquè m’he trobat el mateix problema fent altres coses. I comentant-ho amb el Ramiro a ell també li havia passat
Existing GitHub issues

[ ] I have searched existing GitHub issues to make sure the issue does not already exist.

Hi Guille, given that the Experiment class is deprecated and will be removed soon, I will close this issue.


Feature: Keyword Recognition

https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/keyword-recognition-overview

Yess! :)


GRID-313: Sort only tree column's expandable rows

Essentially, added treeColumnIndex and isTreeColumn in DataSourceDepthSorter.

@Dwaynekj please review

Calling this a bug now as it has become clear that there was no use case for the previous behavior.

Closing because master instead of develop.


CUDA runtime dependencies are slimmed down

Currently, we install approx. 2.8GB dependencies, because of CUDA. Most of the cuda things (NSight, etc.) are not really required for our use case. Perhaps we can only install the strictly required subset to reduce the install size and time.
Probably many lib* are required, but UI tools are most certainly not required.

Sadly, you are unable to define channels in the meta.yaml for the package-building as described here: https://github.com/conda/conda-build/issues/532#issuecomment-410244068
This means that because nvidia is using channels for their versioning, our installation for karabo will look something like this:
conda install -c i4ds -c conda-forge -c nvidia/label/cuda-11.7.0 karabo-pipeline

Karabo gets bigger and bigger due to more functionallity.
Here is the top 10:

nsight-compute-2<IP_ADDRESS>-0.json:                      "size":  485381969,
libcublas-dev-<IP_ADDRESS>-h0c8ac2b_0.json:            "size":  324267418,
libcusparse-dev-<IP_ADDRESS>-hc644b96_0.json:         "size":  315781272,
libcublas-<IP_ADDRESS>-he442b6f_0.json:                   "size":  314450443,
libcufft-dev-<IP_ADDRESS>-h59a5ac8_0.json:                "size":  205997732,
libcusparse-<IP_ADDRESS>-h6aaafad_0.json:                  "size":  155592022,
libnpp-<IP_ADDRESS>-h3effbd9_0.json:                         "size":  124218053,
libnpp-dev-<IP_ADDRESS>-hb6476a9_0.json:                "size":  121327534,
cuda-nvvp-11.7.50-hd2289d5_0.json:                   "size":  119873153,
cuda-nsight-11.7.50-0.json:                                 "size":  119141042,

I checked the karabo_dev_env with the following command: grep '"size":' ${CONDA_PREFIX}/conda-meta/*.json | sort -k3rn | sed 's/.*conda-meta\///g' | column -t
Nvidia nsight for example is a GPU profiler - we have it twice in the top 10, place 1 & 10 with around 600MB in total.


Add values.yaml for readonly cp for apk helm

Purpose

$subject

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Strategy "fixed" invalid position in containing block

CodeSandbox demo

https://codesandbox.io/embed/dazzling-leftpad-cszp1?fontsize=14&hidenavigation=1&theme=dark
Steps to reproduce the problem

Set strategy to fixed
Place popper element inside containing block
Popper element will not calculate it's fixed position related to containing-block, but will calculate position related to window

What is the expected behavior?

With strategy fixed popper should find nearest containing block parent and calculate position related to this containing block.
What went wrong?

Position has been calculated incorrect.
Any other comments?

⚠ This was working properly in popper@1
Also placement works fine with strategy absolute

https://github.com/popperjs/popper-core/issues/1035

@atomiks
Don't understand your point of view. According to CSS Specification: https://drafts.csswg.org/cssom-view/#dom-htmlelement-offsetparent offsetParent will always return null in case where element has position fixed, will-change doesn't  change anything there. Additionally strategy fixed is broken in every browser and in this case I expect for library to do calculactions better. I thing that you should consider options:

Remove deprecated flag in popper@1, cause popper@1 worked better than popper@2 for strategy fixed
Do some calculations in popper@2 to ensure you do element placement related to containing block.
Maybe there should be extra strategy for this use case (containing blocks)
Maybe you can give user option to manually set offset-parent, then we can do calculations on our side, eg. config option:

function getOffsetParent(element, popperOffsetParrentGetter) {}

then user could simply do something like that:
{
  getOffsetParent: (element, popperOffsetParrentGetter) {
    let offsetParent = popperOffsetParrentGetter(element);
    if (!offsetParent || offsetParent === window) {
      offsetParent = customParentCalculation(element);
    }
    return offsetParent;
  }
}

For now we are blocked and can't do anything to make this work and for now we need to stay with popper@1, but it always warns that is deprecated.
Please do something with that.

@atomiks actually even if I remove will-change: transform the bug can still be reproduced. It seems to be a different issue.
https://codesandbox.io/s/small-feather-n99pf

@wszydlak the problem is described in the ticket @atomiks linked above, there's a bug in the browsers implementation of transform that makes so that fixed elements get positioned relatively to the transform parent rather than the document viewport. The browsers don't report this kind of parent as an offsetParent so there's no way to detect them in a performance sensitive way.


[Infrastructure] Update configlet to use authentication

@kotp There are two steps involved:

Update the script to the latest version to have it send authentication headers to GitHub.
Add a GITHUB_TOKEN environment variable (probably as a secret) to your Travis repository that enables you to fetch data. At this point, I can't help you, but @kytrinyx can probably help you out with this.

Originally posted by @ErikSchierboom in https://github.com/exercism/ruby/pull/1026#issuecomment-607069051

@kotp This week, @kytrinyx added an environment variable to the Travis environment that is named NOT_KYTRINYX_TOKEN (for reasons). Could you create a PR that tries to use this token with the updated version of the configlet script and see if it works (no errors)?

I believe this can be closed. If I'm wrong, please reopen with a comment about what needs to be done.


Dragging area does not work under Mac

Looks like DefaultDragHandler  does not work at Mac for frameless window.
framelessOption.IsDraggable is never called under Mac, while on Windows it works without issues.

@xplicit frameless feature is implemented for Windows only.


py3-violating exception in silx/third_party/_local/concurrent_futures/_base.py, line 414

I am trying to build a conda package for silx 0.9.0, and doing that runs into a problem of:
compiling .pyc files...
  File "lib/python3.6/site-packages/silx/third_party/_local/concurrent_futures/_base.py", line 414
    raise exception_type, self._exception, self._traceback
                        ^
SyntaxError: invalid syntax

To be clear, silx 0.9.0 imports and appears to run fine for me.
I'm left wonderign how others have created a conda package,  but it seeems like this should be fixed by replacing this with raise exception_type(self._exception, self._traceback), I  believe.

Hi,
This file is only used with Python2 as a backport of python3 features.
If you are packaging silx for python3 only, you can remove this file, everything will continue to work.
We can make the syntax python3 compatible for cases were every module is blindly compiled.
BTW, silx.third_party embeds some dependencies of silx (including python3 backports among others).
Provided that the corresponding dependencies are available, silx.third_party._local can be removed.
This is done for Debian packaging.

@t20100 yeah, it looks like it is not really used, or at least the limited parts of silx (basically, reading spec files) seem to never have a problem.   But,  when I try to build a conda package from 0.9.0 without modifying the source tree at all, it wants to byte-compile all the files, and so fails.  I'm sort of puzzled how others managed to build a conda package.
I guess I can fork and fix or remove this code before creating a package, but it seems like an issue you all would want to be aware of.

Thanks for letting us know. I'm not familiar with conda packaging, and I did not know that there was byte-compilation in the packaging process. I suppose the current conda packagers must have a script that gets rid of the problematic third-party directories.
Do we know who is doing the packaging at present? I can't find any information about the uploader on conda-forge.

I think we should modify the code to solve the issue.

We can make it py2/py3 compatible by either not providing the traceback to the exception or using six.reraise to maintain the very same feature.
I'm fine with first option, anyway this code is used at a single place in silx and for python2 support... so we'll get rid of it in the future.

@t20100
Since that code is going to be actually executed (if ever) under Python2, the simplest solution seems to me something in the lines of replacing the offending line by:
exec("raise exception_type, self._exception, self._traceback")
That should work under Python2 while making Python3 happy.

@newville
The alternative way of preventing the issue when building the package could be to skip the generation of .pyc files.
https://github.com/conda/conda-docs/pull/365/commits/58fe1166d8270dc45e815f60ad9ce46582fb4e07
Unless the conda machinery ignores it, an even simpler solution would be to set the environment variable PYTHONDONTWRITEBYTECODE when building the package.

@vasole @t20100 Well, raise exception_type(self._exception, self._traceback)  is valid syntax for both Python3 and Python2.  I don't know if it does what you intend.... perhaps you test that?  Anyway,  that works for me to make conda packages for Python3.6, at least for linux and macos (haven't tried windows yet).
I'd be willing to make a PR if that seems like a desirable solution.  Using exec() or preventing byte compilation seem like attempts to avoid triggering a known problem in the code in place of actually fixing the code.  I'm not eager to take that approach.
I have to admit being completely baffled by the third_party stuff here.  Why do you include your own copy of six and use complicated import statements that prefer your own version over the "normal" package?  Why don't you just require six>=0.10?   Similarly, why not just use scipy.spatial instead of your own copy?  I really don't get why any of this exists... Isn't it just extra work for you?  It certainly is work for me now.
Any chance that the code to read spec files could be a separate library?

Are you sure that syntax is valid? I'm saying it because if you take a look at six.reraise they follow the exec approach instead of following your proposed solution:

https://github.com/benjaminp/six/blob/master/six.py

own copy of some modules. Those modules are not available as packages on all the distributions used at the ESRF.

As t20100 pointed out in his very first reply, you can just get rid of the _local directory.


Docs changes from machine PR #3799

Resubmitting PR for docs changes for machine PR https://github.com/docker/machine/pull/3799. Looks like that PR will be merged shortly and doc update can be coordinated.

@nathanleclaire @mrburrito @mstanleyjones about to merge this into vnext-machine  if no objections?

late to the game but LGTM


Cannot set viaParams on a via using TCL

The TCL function dbVia_setViaParams doesn't accept enough arguments, so I'm unable to set the via parameters
% $block getVias
_a0b0839e267f0000_p_odb__dbVia
% set via _a0b0839e267f0000_p_odb__dbVia
_a0b0839e267f0000_p_odb__dbVia
% $via hasParams
0
% set params [$via getViaParams]
_b048730100000000_p_odb__dbViaParams
% $params setNumCutRows 3
% $params getNumCutRows
3
% [$via getViaParams] getNumCutRows
1
% $via hasParams
0
% $via setViaParams $params
Wrong # args.:dbVia_setViaParams self  argument 2
Clearly [$via getViaParams] is returning a copy of the viaParams object. This being the case, I need to be able to set the params to a modified set by calling the $via setViaParams function - however, this function does not accept a dbViaParams object as an argument.

This seems to work correctly in the develop branch now - I have submitted some tests under a different issue. From my point of view this issue can be considered resolved and fixed.

I pushed a fix in #27, but was not sure about the test case, thanks for your feedback.


components/chatbot: change font color for 'End Chat'

What sort of change have you made:

[x] Code style update (formatting, local variables)

Maybe assign me under gssoc
referencing Issue #273

Issue still not assigned to you, Closing the PR.

@singodiyashubham87 ive updated this, would this still be relevant?

@Wahid7852 You need create a new PR, As this PR was raised before you were even assigned the issue.

ah sure no problems


Add support for multiple graphs

Can switch between multiple input sets on the UI for different graphs.
Estimated 10 man-hours.

Moved to third iteration due to time constraints.


Is there an option to use helm instead of ido to do completing-read?

as title.

Customize javadoc-lookup-completing-read-function to a different
function of your choice. The function you choose needs to have an
interface similar to completing-read.

Oh, cool! Thank you! It was my bad, I tried to redefine the variable javadoc-lookup-completing-read-function, after I set the variables instead of redefine it. It solved the problem.
(setq javadoc-lookup-completing-read-function #'completing-read)


VoiceOver doesn't announce details element's role and states

This issue is from the accessibility audit of GOV.UK Frontend components by DAC in July 2024.
DAC's description

Page: Details
WCAG reference: none (usabililty)
Issue ID: DAC_Usability_Detail_Component_01

For users of screen reading assistive technologies the details component does not convey its state or functionality for users navigating with VoiceOver.

Screen reader comments:
“A details component was present on the page which expanded and collapsed content when selected in relation to an issue with the e-mail. However, with VoiceOver this item did not announce either as a link or as a button and did not advise me of when content was collapsed or expanded.
I was not immediately aware that the item was selectable and would have been unable to identify the component to select when browsing out of context.
Ensuring that the item announces as either a link or as a button and clearly advises me of whether content collapses or expands will prevent any difficulty and will ensure that I can access the content. In my opinion it may be better to use an accordion feature rather than this details component as the accordion works with all screen reader software”
DAC's proposed solution
Consider using a button for the default detail component as this will mean it is recognised by and will convey its correct state to all assistive technologies.
Other potential solutions
This is a known issue with VoiceOver. This happens with all native HTML <details> elements, irrespective of implementation.
We don't know yet what the best solution would be, we need to discuss and explore this further first.
We might need to change the guidance to refer to the known issues.
Another option is to lobby for making Apple fix the bug in VoiceOver.
Related issues

https://github.com/alphagov/reported-bugs/issues/29
https://github.com/alphagov/reported-bugs/issues/28
https://github.com/alphagov/govuk-frontend/issues/3693
https://github.com/alphagov/govuk-design-system-backlog/issues/44
https://github.com/alphagov/govuk-frontend/issues/988
https://github.com/alphagov/reported-bugs/issues/64
https://github.com/alphagov/govuk-frontend/issues/4972
https://github.com/alphagov/govuk-frontend/pull/5089

Additional instances
Although the details component is used on multiple pages throughout the website, it is always the same component, so will only need to be fixed once.
Needed roles
Frontend developer, content designer

For the sake of clarity, can we check which browsers this was tested in, and also whether it's specific to macOS VoiceOver or is also an issue with iOS VoiceOver?

@querkmachine, nearly all of the previous issues specifically mention iOS. But I tested just to double check. I can confirm it is only a problem with VoiceOver on iOS. There is no other real browser on iOS other than Safari. (From what I remember, all the other browsers use Safari's rendering engine.)

Closing this via https://github.com/alphagov/govuk-frontend/issues/5310

A quick summary of what we have done...
After we investigated this, we found that there was a problem with our specific implementation using inline-block.
That fixed the issue for VoiceOver on iOS versions 17 and 18.
There are multiple VoiceOver bugs involved. While we could fix the issue for versions 17 and 18, we couldn't find a fix for older versions (which was due to a different VoiceOver bug).
I have summarised all the technical details around the details element in this JSbin, including testable code.


Different textstyles next to an image

First of, thanks for the great plugin!
The plugin almost accomplishes what I try to do. Except for one thing. I'd like to have an inline image, with text next to it. But this text consists out of a header and out of a body. And the header should have a different font-size. E.g.:

Any suggestions on how I might accomplish this?

you can start by using the property "parseInlineMarkdown" as true, so you could provide a markdown like text as the example below
text = "**A floating Image**\nIste quidem veteres...."
it will make the first line Bold but it will not make it bigger in font-size.
I'm going to support full markdown in the future

@mtiziano you can consider about passing a "RichText|Text|TextSpan..." widget to your plugin rather than only a text String.

maybe in the future


GitHub roadmap project refers to 2023 in title

This is a trivial issue, but since I happened upon it, may as well report it: the sole GitHub project in the Projects tab is titled "Cirq 2023 roadmap". If this is not deliberate, perhaps it would make sense to change the year to 2024?

TODO @pavoljuhas - close the 2023 roadmap, transfer open tasks to 2024.

TODO @pavoljuhas - close the 2023 roadmap, transfer open tasks to 2024.

Done.  Cirq 2024 roadmap is thus far private, will be published soon.

Closing as done.


Training takes too long!!

Hello, I was wondering what are the training times for the demonstrations.
I just tried the english seq labeler, and it took 1 hour to process 10% of the corpus! (is this normal?)
It's known Deep Learning is CPU hungry, I have only 2 cores and 8GB RAM (sorry)
¿do I need to change the PC) or acquire a CUDA core to help computing?
¿Is there a way to stop learning manually, or programmatically after reaching certain error rate?
I am wondering if you ever tried sequence labelling on highly inflectional languages (like Spanish) which has lots of inflectional power (complexity) and the words as a whole string are useless, the vocabulary explodes into >300M words! and the "examples"found on text begins to be too sparse, even with negative sampling you never get certain combinations, because most verbs have over 200 versions of itself (inflections), including time-tense, person, gender, plurality, mode, etc. So there is  need to train on higher level features, but not losing the "semantic" sense. ¿do you think this could be possible, like decomposing the words (by means of controlled independent lemmatization) into parts/chunks (prefix, root, suffix,  as well as modal information and semantic features of the parts,) My intuition is that this might lower the training and may be better the generalization power with less extensive corpus. Like capturing higher level syntax rules,  and by the way generating semantic content constraints (may be even some common sense)...
It's just a question, on theory!

Hi @andy-soft,
For your labeling task, how many categories do you want to label ? Could you please share the configuration file your are using with me ? Then I will estimate if current performance is reasonable. Currently, RNNSharp doesn't support GPU training. It supports CPU training with SIMD instruction only, so you need to have a powerful CPU with new SIMD instruction set, such as AVX, AVX2 and so on.
I did use RNNSharp for sequence label tasks on inflectional languages, such as English, such as pos-tag, named entity and so on. Usually, the labeling categories is no more than 50. If labeling categories is too much, it will definitely affect performances, and you should optimize them, such as splitting them to a few of basic units for labeling. If it's really hard to reduce the number of them, you could use SampledSoftmax as output layer type. For each token, It randomly samples some categories plus categories on current labeling sentence for training, instead of the entire categories set.

Hello, thanks for the reply.
Actually I was only testing the labels on the english NER labels (I think
there are only 5-6 entity types, and with the BIO labels there are at most
12-15 labels). My Level of classification is about the same, may be at most
20 total labels. (B I O S, with 10-15 entity types)
the problem is the many labels of each word, the variability is huge, more
than 900 different POS labels, (EAGLES 2 version)
I can sub-sample them, creating a 2 level problem, but I don't know how the
LSTM will behave on this. and even how to compose the output layer. Too
much complex is the problem, I hope to discover how to combine so much
labels and POS parts into one problem. As I told you before. But thank you
for answering and doing such a good programming,
I used another word2vec encoder from google, and got a severe low
performance, then y Refactored it, but something went wrong and the
resulting system trains well, but the cosine distance is too close to one
always, and could not find the problem I might have introduced. I speed the
thing 20 times, by programming well some parts. May be I will help you
also, I am some sort of skilled programmer under C# (30 years programming)
& thanks again!
On Fri, Apr 21, 2017 at 9:22 PM, Zhongkai Fu<EMAIL_ADDRESS>wrote:

Hi @andy-soft https://github.com/andy-soft,
For your labeling task, how many categories do you want to label ? Could
you please share the configuration file your are using with me ? Then I
will estimate if current performance is reasonable. Currently, RNNSharp
doesn't support GPU training. It supports CPU training with SIMD
instruction only, so you need to have a powerful CPU with new SIMD
instruction set, such as AVX, AVX2 and so on.
I did use RNNSharp for sequence label tasks on inflectional languages,
such as English, such as pos-tag, named entity and so on. Usually, the
labeling categories is no more than 50. If labeling categories is too much,
it will definitely affect performances, and you should optimize them, such
as splitting them to a few of basic units for labeling. If it's really hard
to reduce the number of them, you could use SampledSoftmax as output layer
type. For each token, It randomly samples some categories plus categories
on current labeling sentence for training, instead of the entire categories
set.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/zhongkaifu/RNNSharp/issues/34#issuecomment-296333011,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ANCPcZoGdi_nQOkZ5NDlNoD9IjFYWh5iks5ryUhUgaJpZM4NE58d
.

--
ing. Andrés T. Hohendahl
director
PandoraBox
www.pandorabox.com.ar
web.fi.uba.ar/~ahohenda

It's really appreciated if you could make contribution for RNNSharp. :)
For word2vec, you can try my version: https://github.com/zhongkaifu/Txt2Vec It has higher performance than original word2vec and supports incremental training.
For "the problem is the many labels of each word, the variability is huge, more
than 900 different POS labels, (EAGLES 2 version)", could you please make a specified example about it ? Sorry that I don't understand about it.

Hi Zhongkai
I tried your txt2vector version, and the performance of yours is similar
(even slightly less) than word2vec (a C# port I've modified) the Threaded
part and the logger may slow down the system, even the double[] vector
calculus makes it a bit slower, I guess.
I will send you my modified version, I have made some optimizations
manually inside the code (well commented)
The 900 Label problem lies on that Spanish, as well as many european langs,
do swallow many aspects of the statements, like numerosity, gender,
diminutives, augmentatives, in the case of verbs even the person and mode
are inside the morphology of each word, worst of all, people use many
prefixes to modify the semantics-only of the word, which results in a new
word for the vocabulary, if it takes only the written form, not the
decomposed one which I can split using my libraries based upon a huge
Spanish word corpus (>300Mw) I've collected over the last 12 years. Even
each prefix and suffix, adds semantic information upon the word, and I
guess this can be used to train several "aspects" of a RNN, allowing a
better comprehension of the phrase, for NLU based systems.
For example the way a Named entity like a place is prepended and the way a
sentence construct treats it is similar to those of an organization, but
slightly different to a proper name, or person. But a person is also
addressed inside a sentence as something different, and the "semantic"
properties of the verbs involved as well as the adjectives, do possess
information to determine even if an adjective or a simple noun, or pronoun
is referring to a person, so the Anaphora detection should be done inside
this "smarter" Named Entity Detector which I am seeking to build, may be
with several parallel stages, trained upon "nameability" or "placeability"
(sorry for teh OOV, but this is what I want to mean).
For example, in Spanish the word: "hiperrecontrabuenísimo" is an OOV (not
in conventional dictionaries) but for a native speaker, it means clearly
the prefix+suffix+root meanings, this is "hiper" (augmentative) "recontra"
(another augmentative) buen (good) + (ísimo) another augmentative, so this
word as well as many others of this type, are used in colloquial
chat/conversation, but neither ends in any dictionary ever!
So my idea is to train a network capable of extracting sense-relationship
embedded inside syntax relations, like verb (root) to direct object (root)
relation with semantic features.
The tags have a string representation, just search for EAGLES format, it;s
a extended POS tag, much more complete than english tags, (Penn treebank
and others alike) the length is variable and they are like this: NCMS  for
Common Noun Masculine Singular
you can imagine the thousand combinations for each POS class, as well as
the sub-classifications.
Just this, hope you understood my ideas, If you have any idea or question,
it will be addressed, and responded quickly!
best regards
Andrés
On Sat, Apr 22, 2017 at 12:45 AM, Zhongkai Fu<EMAIL_ADDRESS>wrote:

It's really appreciated if you could make contribution for RNNSharp. :)
For word2vec, you can try my version: https://github.com/zhongkaifu/
Txt2Vec It has higher performance than original word2vec and supports
incremental training.
For "the problem is the many labels of each word, the variability is huge,
more
than 900 different POS labels, (EAGLES 2 version)", could you please make
a specified example about it ? Sorry that I don't understand about it.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/zhongkaifu/RNNSharp/issues/34#issuecomment-296344702,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ANCPcetxlLeVjPt2oLaYXvcFnPMuZGmNks5ryXfAgaJpZM4NE58d
.

--
ing. Andrés T. Hohendahl
director
PandoraBox
www.pandorabox.com.ar
web.fi.uba.ar/~ahohenda

Hi Andrés,
Thanks for your explanation in details. It's really helpful.
For your task, to improve performance and reduce the number of output categories, you could try sub-word level segmentation and labeling or character level segmentation and labeling. As the example you mentioned in above "hiperrecontrabuenísimo", if you have sub-word dictionary for training, you could build training corpus likes:
hiper \t S_Aug1
recontra \t S_Aug2
buen \t S_CorePart
ísimo \t S_Aug3
So, Label "Aug1Aug2CorePartAug3" is split into four basic tags. Or you could try character level labeling, such as
h \t B_Aug1
I \t M_Aug1
p \t M_Aug1
e \t M_Aug1
r \t E_Aug1
By this way, it will significantly reduce the number of output categories.
Thanks
Zhongkai Fu

In addition, did you try the latest RNNSharp code (check out from master branch) ? It's much faster than the released version, since I have not updated release package yet.

No, I'll try tomorrow,
thanks
I am still trying to understand all you told me,
but too tired now!
Until tomorrow!
On Sat, Apr 22, 2017 at 8:00 PM, Zhongkai Fu<EMAIL_ADDRESS>wrote:

In addition, did you try the latest RNNSharp code (check out from master
branch) ? It's much faster than the released version, since I have not
updated release package yet.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/zhongkaifu/RNNSharp/issues/34#issuecomment-296407061,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ANCPcYUlPJgVHZuxi3vB5n1SlztVrIaAks5ryoZ_gaJpZM4NE58d
.

--
ing. Andrés T. Hohendahl
director
PandoraBox
www.pandorabox.com.ar
web.fi.uba.ar/~ahohenda

I am training a NER for spanish, with a small corpus 8k tokens, and it
takes too long, adn got stuck, Token error rate don't lowers, less than 9%
info,31/5/2017 3:02:41 p. m. Progress = 8K/8,323K
info,31/5/2017 3:02:41 p. m.  Train cross-entropy = 0,320236720036713
info,31/5/2017 3:02:41 p. m.  Error token ratio = 7,50999862854771%
info,31/5/2017 3:02:41 p. m.  Error sentence ratio = 64,1830228778597%
info,31/5/2017 3:03:06 p. m. Iter 33 completed
info,31/5/2017 3:03:06 p. m. Sentences = 8323, time escape =
00:09:20.6314274s, speed = 14,8457606784532
info,31/5/2017 3:03:06 p. m. In training: log probability =
-27240,7618759363, cross-entropy = 0,321621874395561, perplexity =
1,24973470831842
info,31/5/2017 3:03:06 p. m. Verify model on validated corpus.
info,31/5/2017 3:03:06 p. m. Start validation ...
info,31/5/2017 3:03:24 p. m. In validation: error token ratio =
7,13251598951747% error sentence ratio = 66,4469347396177%
info,31/5/2017 3:03:24 p. m. In training: log probability =
-5154,61463169968, cross-entropy = 0,313802466020867, perplexity =
1,24297946835413
it is training since yesterday, when will it stop?
this was the bat:
SET CorpusPath=.\Data\Corpus\NER_ES
SET ModelsPath=.\Data\Models\NER_ES
SET BinPath=..\Bin
REM Build template feature set from training corpus
%BinPath%\TFeatureBin.exe -mode build -template %CorpusPath%\template.txt
-inputfile %CorpusPath%\train.txt -ftrfile %ModelsPath%\tfeatures -minfreq 1
REM Encoding LSTM-BiRNN-CRF model
%BinPath%\RNNSharpConsole.exe -mode train -trainfile %CorpusPath%\train.txt
-validfile %CorpusPath%\valid.txt -cfgfile .\config_ner_enu.txt -tagfile
%CorpusPath%\tags.txt -alpha 0.1 -maxiter 0 -savestep 200K
I can send you the training samples, also.
should I buy a CUDA thing!?
best
thanks
On Sat, Apr 22, 2017 at 8:37 PM, Andres Hohendahl <
<EMAIL_ADDRESS>wrote:

No, I'll try tomorrow,
thanks
I am still trying to understand all you told me,
but too tired now!
Until tomorrow!
On Sat, Apr 22, 2017 at 8:00 PM, Zhongkai Fu<EMAIL_ADDRESS>wrote:

In addition, did you try the latest RNNSharp code (check out from master
branch) ? It's much faster than the released version, since I have not
updated release package yet.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/zhongkaifu/RNNSharp/issues/34#issuecomment-296407061,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ANCPcYUlPJgVHZuxi3vB5n1SlztVrIaAks5ryoZ_gaJpZM4NE58d
.

--
ing. Andrés T. Hohendahl
director
PandoraBox
www.pandorabox.com.ar
web.fi.uba.ar/~ahohenda

--
ing. Andrés T. Hohendahl
director
PandoraBox
www.pandorabox.com.ar
web.fi.uba.ar/~ahohenda

According RNN output lines, you are still using older RNNSharp, please sync the latest source code (not released demo package, since I have not updated it yet), build it and train your model.
It's okay you can send training example, configuration file and command line you ran to me.

Thanks Zhonkaifu
I'll download the latest and build them ASAP, & tell you the result
Also I saw some of my mistakes:
I missed an absolute reference on the configuration files, pointing towards
the english version "xxx_enu" and I need to train a text2vec , now I
replaced it as:
WORDEMBEDDING_FILENAME = D:\RNNSharpDemoPackage\WordEmbedding\wordvec_es.bin
And I am going to generate a embedding file for Spanish also!
Andrés
PD:
The bad run, (based on english resources.. bad!) ended it's training 2 days
after, and generated a 1.0 GB model file. I think this lengthy files need
to be pruned somehow, it's not practical to bavea 1.0 Gb parameter file!
The resulting model would be memory + resources hungry ¿might not be useful
for production?
On Wed, May 31, 2017 at 3:20 PM, Zhongkai Fu<EMAIL_ADDRESS>wrote:

According RNN output lines, you are still using older RNNSharp, please
sync the latest source code (not released demo package, since I have not
updated it yet), build it and train your model.
It's okay you can send training example, configuration file and command
line you ran to me.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/zhongkaifu/RNNSharp/issues/34#issuecomment-305273643,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ANCPcVDZCEDg37ES4t3ZMhMnOiD8J5OIks5r_a9tgaJpZM4NE58d
.

--
ing. Andrés T. Hohendahl
director
PandoraBox
www.pandorabox.com.ar
web.fi.uba.ar/~ahohenda

Hi, now I am training on real words, with new routines (just downloaded)
I trained a Spanish corpus of 380 megabytes of raw text, using your
text2vec and created the *.bin for the training, then redirected all the
documents in the configuration, corrected the files with the new syntax, on
the github, and started to train it, but it is still running fo over 1 day,
¿when should it stop?
¿is it not worth to be able to break the training and resume later, using
some kind of console, or whatever? if I abort the training, I loose all the
work done!
Any clue? (I guessed it will stop after the 20th iteration, but the show
still goes on...)
The config file is this:
#Working directory
CURRENT_DIRECTORY = .
#Model type. Sequence labeling (SEQLABEL) and sequence-to-sequence
(SEQ2SEQ) are supported.
MODEL_TYPE = SEQLABEL
#!Model direction. Forward and BiDirectional are supported
#!MODEL_DIRECTION = BiDirectional
#Network type. Four types are supported:
#For sequence labeling tasks, we could use: Forward, BiDirectional,
BiDirectionalAverage
#For sequence-to-sequence tasks, we could use: ForwardSeq2Seq
#BiDirectional type concatnates outputs of forward layer and backward layer
as final output
#BiDirectionalAverage type averages outputs of forward layer and backward
layer as final output
NETWORK_TYPE = BiDirectional
#Model file path
MODEL_FILEPATH = Data\Models\NER_ES\model.bin
#Hidden layers settings. LSTM and Dropout are supported. Here are examples
of these layer types
#Dropout: Dropout:0.5 -- Drop out ratio is 0.5
#If the model has more than one hidden layer, each layer settings are
separated by comma. For example:
#"LSTM:300, LSTM:200" means the model has two LSTM layers. The first layer
size is 300, and the second layer size is 200
HIDDEN_LAYER = LSTM:200
#Output layer settings. Simple, softmax ands sampled softmax are supported.
Here is an example of sampled softmax:
#"SampledSoftmax:20" means the output layer is sampled softmax layer and
its negative sample size is 20
#"Simple" means the final result is the raw output of the layer.
#"Softmax" means the final result is based on "Simple" layer and run softmax
OUTPUT_LAYER = Simple
#CRF layer settings
CRF_LAYER = True
#The file name for template feature set
TFEATURE_FILENAME = Data\Models\NER_ES\tfeatures
#The context range for template feature set. In below, the context is
current token, next token and next after next token
TFEATURE_CONTEXT = 0,1,2
TFEATURE_WEIGHT_TYPE = Binary
PRETRAIN_TYPE = Embedding
#The word embedding data file name generated by Txt2Vec (
https://github.com/zhongkaifu/Txt2Vec)
WORDEMBEDDING_FILENAME = Data\WordEmbedding\wordvec_es.bin
#The context range for word embedding.
WORDEMBEDDING_CONTEXT = 0
#The column index applied word embedding feature
WORDEMBEDDING_COLUMN = 0
#The run time feature
#RTFEATURE_CONTEXT: -1,-2,-3
The bat file is here:
SET CorpusPath=.\Data\Corpus\NER_ES
SET ModelsPath=.\Data\Models\NER_ES
SET BinPath=..\Bin
REM Encoding LSTM-BiRNN-CRF model
%BinPath%\RNNSharpConsole.exe -mode train -trainfile %CorpusPath%\train.txt
-validfile %CorpusPath%\valid.txt -cfgfile .\config_ner_es.txt -tagfile
%CorpusPath%\tags.txt -alpha 0.1 -maxiter 0 -savestep 200K
As I have set maxiter to 0 it will stop when the system no longer betters
its training?
¿how much does your trainer last for english corpus on the downloaded
sample? and on wnay kind of PC / Ram, processor / OS .
Actually my process is consuming 1,9 Gbytes of RAM 100% CPU (2 cores) on a
W10 x64 dual core G2020 (2.66Ghz pentium), not any beast or numeric
workhorse no GPU installed.
The process now has this lectures on the logfile:
info,2/6/2017 2:58:13 p. m. End 28 iteration. Time duration =
00:13:43.3734915
info,2/6/2017 2:58:13 p. m.
info,2/6/2017 2:58:13 p. m. Verify model on validated corpus.
info,2/6/2017 2:58:29 p. m. Progress = 1K/1,517K
info,2/6/2017 2:58:29 p. m.  Error token ratio = 3,60980155684684%
info,2/6/2017 2:58:29 p. m.  Error sentence ratio = 47,7%
info,2/6/2017 2:58:37 p. m. End model verification.
info,2/6/2017 2:58:37 p. m.
info,2/6/2017 2:58:37 p. m.
info,2/6/2017 2:58:37 p. m. Start to training 29 iteration. learning rate =
0,00078125
info,2/6/2017 3:01:26 p. m. Progress = 2K/8,323K
info,2/6/2017 3:01:26 p. m.  Error token ratio = 0,0864513976309284%
info,2/6/2017 3:01:26 p. m.  Error sentence ratio = 1,65%
info,2/6/2017 3:01:26 p. m. Progress = 2K/8,323K
info,2/6/2017 3:01:26 p. m.  Error token ratio = 0,0864513976309284%
info,2/6/2017 3:01:26 p. m.  Error sentence ratio = 1,65%
info,2/6/2017 3:06:03 p. m. Progress = 5K/8,323K
info,2/6/2017 3:06:03 p. m.  Error token ratio = 0,091533180778032%
info,2/6/2017 3:06:03 p. m.  Error sentence ratio = 1,78%
info,2/6/2017 3:06:03 p. m. Progress = 5K/8,323K
info,2/6/2017 3:06:03 p. m.  Error token ratio = 0,091533180778032%
info,2/6/2017 3:06:03 p. m.  Error sentence ratio = 1,78%
info,2/6/2017 3:07:35 p. m. Progress = 6K/8,323K
info,2/6/2017 3:07:35 p. m.  Error token ratio = 0,0901244410551492%
info,2/6/2017 3:07:35 p. m.  Error sentence ratio = 1,81666666666667%
info,2/6/2017 3:09:01 p. m. Progress = 7K/8,323K
info,2/6/2017 3:09:01 p. m.  Error token ratio = 0,0972418293405895%
info,2/6/2017 3:09:01 p. m.  Error sentence ratio = 1,9%
info,2/6/2017 3:09:01 p. m. Progress = 7K/8,323K
info,2/6/2017 3:09:01 p. m.  Error token ratio = 0,0972418293405895%
info,2/6/2017 3:09:01 p. m.  Error sentence ratio = 1,9%
info,2/6/2017 3:10:41 p. m. Progress = 8K/8,323K
info,2/6/2017 3:10:41 p. m.  Error token ratio = 0,100398246377297%
info,2/6/2017 3:10:41 p. m.  Error sentence ratio = 1,9125%
info,2/6/2017 3:11:11 p. m. End 29 iteration. Time duration =
00:12:34.1796782
info,2/6/2017 3:11:11 p. m.
info,2/6/2017 3:11:11 p. m. Verify model on validated corpus.
info,2/6/2017 3:11:27 p. m. Progress = 1K/1,517K
info,2/6/2017 3:11:27 p. m.  Error token ratio = 3,53827053870236%
info,2/6/2017 3:11:27 p. m.  Error sentence ratio = 46,4%
info,2/6/2017 3:11:34 p. m. End model verification.
info,2/6/2017 3:11:34 p. m.
info,2/6/2017 3:11:34 p. m.
info,2/6/2017 3:11:34 p. m. Start to training 30 iteration. learning rate =
0,00078125
On Thu, Jun 1, 2017 at 3:49 PM, Andres Hohendahl<EMAIL_ADDRESS>
wrote:

Thanks Zhonkaifu
I'll download the latest and build them ASAP, & tell you the result
Also I saw some of my mistakes:
I missed an absolute reference on the configuration files, pointing
towards the english version "xxx_enu" and I need to train a text2vec , now
I replaced it as:
WORDEMBEDDING_FILENAME = D:\RNNSharpDemoPackage
WordEmbedding\wordvec_es.bin
And I am going to generate a embedding file for Spanish also!
Andrés
PD:
The bad run, (based on english resources.. bad!) ended it's training 2
days after, and generated a 1.0 GB model file. I think this lengthy files
need to be pruned somehow, it's not practical to bavea 1.0 Gb parameter
file! The resulting model would be memory + resources hungry ¿might not be
useful for production?
On Wed, May 31, 2017 at 3:20 PM, Zhongkai Fu<EMAIL_ADDRESS>wrote:

According RNN output lines, you are still using older RNNSharp, please
sync the latest source code (not released demo package, since I have not
updated it yet), build it and train your model.
It's okay you can send training example, configuration file and command
line you ran to me.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/zhongkaifu/RNNSharp/issues/34#issuecomment-305273643,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ANCPcVDZCEDg37ES4t3ZMhMnOiD8J5OIks5r_a9tgaJpZM4NE58d
.

--
ing. Andrés T. Hohendahl
director
PandoraBox
www.pandorabox.com.ar
web.fi.uba.ar/~ahohenda

--
ing. Andrés T. Hohendahl
director
PandoraBox
www.pandorabox.com.ar
web.fi.uba.ar/~ahohenda

First of all, your CPU has only two cores, this is the main reason why training is slowly.
Secondly, I don't know if your CPU support AVX and AVX2 instructions which is for SIMD to speed up training. You could show a few of first log lines with me, and I will take a look.
Finally, you could set TFEATURE_CONTEXT=0 to reduce the number of sparse features to speed up training.

It just ended running, I'll attach the log file (compete)
My CPU is a G2020, here is the FULL Spec:
[image: Inline image 1]
I will probably make a FROM application to control the training-run
process, to visualize, and eventually stop and/or change parameters
on-the-run, may be this could be better to control, for guys who as me,
have slow CPU's
On the other hand, ¿have you seen the approach done by the people of
facebook, with fast-text? they claim to have lowered many orders of
magnitude the training by means of subsampling, I attach the link to the
git. (may be I can port it into C#, bettering the overall methods). I plan
to use this for real world application NER, in Spanish, which has as I told
you before, a very rich inflective mode on the words, and therefore the
words are agglutinative, unlike chinese, they contain lots of semantic,
grammatical and modal information inside their structure, generating a very
huge number of inflected word-forms, based upon only a small root-words
set. This makes a trainer collide if not using this info, I have built a
morphological analyzer which is able to "strip down" the words into a large
set of variables, some are semantic, some are gender, numer, root,
prefixes, suffixes, time/person/mode/colloquial in case of verbs, among
many others. ¿is there a way to train a RNN with this sparse-features
representing the same word and position of the word? I guess the feature
extractor should be tailored, I can do this!
Also I guess a NER chunker, could benefit from a multi-stage classifier,
one to detect the "entities boundaries" and other to classify the entity,
once you get the segment, you can re-classify it with another better and
simpler in-segment classifier.
For example, time-related entities, the variability in Spanish is so huge
that probably any classifier get nuts to set the boundaries, and also there
will never be enough samples of this named entities, due to the multiple
variations, to train a complete system.
I will try to do this, even with other named entities the problem is very
alike.
Thanks for your collaboration.
If you want to take a look to my work in NLP, I can attach you a PDF, in
English (but I don want it public on this thread) to a private email
address.
best regards
Andrés
On Fri, Jun 2, 2017 at 4:43 PM, Zhongkai Fu<EMAIL_ADDRESS>wrote:

First of all, your CPU has only two cores, this is the main reason why
training is slowly.
Secondly, I don't know if your CPU support AVX and AVX2 instructions which
is for SIMD to speed up training. You could show a few of first log lines
with me, and I will take a look.
Finally, you could set TFEATURE_CONTEXT=0 to reduce the number of sparse
features to speed up training.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/zhongkaifu/RNNSharp/issues/34#issuecomment-305891358,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ANCPcSJI4hsRDO4Gqtr5_uYuHPGM6hjOks5sAGXzgaJpZM4NE58d
.

--
ing. Andrés T. Hohendahl
director
PandoraBox
www.pandorabox.com.ar
web.fi.uba.ar/~ahohenda

Hi Andrés
It's really appreciated if you would like to contribute RNNSharp project. :)
I cannot get your inline image for CPU G2020. According information at http://www.cpu-world.com/CPUs/Pentium_Dual-Core/Intel-Pentium G2020.html, it seems this CPU doesn't support AVX and AVX2 instructions, so RNNSharp cannot emit SIMD instruction to speed up.

Hi Zhongkai Fu
I'll see to get a intel Core i5-3570 ASAP, if the speedup is worth (at
least 2 more cores!) i7 is the same, as hyperthreading does not help too
much, each thread has only half time slot!!!
I am also seeing the new AMD Ryzen 7 chips, but still fear their
compatibility with MS .net technologies for now, there have been some
awkward reports!
One more question
¿do you instruct explicitly in RNNSharp to issue SIMD instructions?
¿or is this handled by the internal .NET CLS JIT compiler? - I guess.
have to check if the .net runtime informs something on this!
I guessed (as in many information boards) Ivy Bridge series chips were AVX
compatible, but it seems intel has crippled them down in the chip, to
brighten their core i5/i7/i9 series, as he does to tailor our budgets.
thanks for the info!
Andrés
On Sat, Jun 3, 2017 at 3:02 AM, Zhongkai Fu<EMAIL_ADDRESS>wrote:

Hi Andrés
It's really appreciated if you would like to contribute RNNSharp project.
:)
I cannot get your inline image for CPU G2020. According information at
http://www.cpu-world.com/CPUs/Pentium_Dual-Core/Intel-Pentium G2020.html,
it seems this CPU doesn't support AVX and AVX2 instructions, so RNNSharp
cannot emit SIMD instruction to speed up.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/zhongkaifu/RNNSharp/issues/34#issuecomment-305954159,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ANCPcVSAjeTKf76TWQ8UoLY4kzvZNqRdks5sAPbpgaJpZM4NE58d
.

--
ing. Andrés T. Hohendahl
director
PandoraBox
www.pandorabox.com.ar
web.fi.uba.ar/~ahohenda

I'm using System.Vectors which is a component of .NET core to emit SIMD instruction (AVX and AVX2) for RNNSharp.
If that AMD CPU supports these AVX instructions, RNNSharp can leverage them as well.

Hi there, I just got a CPU with 16 cores and 128Gbytes of RAM. Ready to train hard!!

Cool!
I recently introduced MKL into Seq2SeqSharp and got a significantly improvement on performance, if you like, you could try it in RNNSharp.

Greath, which are the files to download and test it?
Also ¿did you try to make int into service to set this to work as a REST or
something else? (to be consumed from other apps)
BTW I am going to send you some improvements over text2vec soon. (speed and
flexibility)
& + thanks
ing. Andrés T. Hohendahl
web.fi.uba.ar/~ahohenda
ofic: +54 (11) 2194-6435
On Sat, Aug 25, 2018 at 8:47 PM Zhongkai Fu<EMAIL_ADDRESS>wrote:

Cool!
I recently introduced MKL into Seq2SeqSharp and got a significantly
improvement on performance, if you like, you could try it in RNNSharp.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/zhongkaifu/RNNSharp/issues/34#issuecomment-416003669,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ANCPcdsGOqxYE1JvbKiP_EwLIpu2LNImks5uUeIPgaJpZM4NE58d
.

I just ut to train the sample of English SeqClassification (NER) from yout sample 143Mb text file, 2.2M words.
I set up a 32 core Xeon 3500 server, with 120 Gb Ram, and it took >24 hours to reach a 0.89% token error, 8% seq error. (About 40% of total training time, then I aborted it)
I am scared of the unusual time to train those sets.
The binary model file is 1.8Gb long !!
¿Are those normal training times, and model sizes.. ?
¿or should I go and purchase a CUDA multi core and use another LSTM library?


Optional JSON field can't be set to SQL NULL, only JSON null

[x] The issue is present in the latest release.
[x] I have searched the issues of this repository and believe that this is not a duplicate.

Current Behavior 😯
When using an Optional JSON field, there doesn't seem to be any way to have the field be NULL. It always uses JSON null (even when using a entsql.DefaultExpr or entsql.Default).
Expected Behavior 🤔
An unset optional JSON field should have some mechanism for setting it to regular SQL NULL.
Steps to Reproduce 🕹
Define a JSON field on an entity.
I've tried:

.Default(nil) on the field (codegen fails)
Passing nil to fields.JSON instead of &nil (codegen fails)
Using annotation entsql.DefaultExpr("NULL") and entsql.Default("NULL") (codegen passes but it still uses JSON null)

I think this behavior is a reasonable default, but it seems like the entsql.DefaultExpr should be usable to override it.
Your Environment 🌎

Tech
Version

Go
1.21.3

Ent
0.12.2

Database
MySQL

Driver
https://github.com/go-sql-driver/mysql

If the column is optional (nullable), you don’t need to set it a default. It will be NULL if nothing was inserted to it.
If order to unset the value in a column (set to NULL), use the Clear modifier.
Closing, but feel free to join our Discord in case you need more help with this.

Thanks @a8m! I figured out that in my situation, it was because I had something like:
var someMap := map[string]string{}
...
someMap = nil

Ent.Foo.Create().SetSomeJSONColumn(someMap)
...

Even though the value is nil, the underlying type is a map. This causes the DB row to get a JSON null. Whereas if you don't call SetSomeJSONColumn at all (or you pass a literal untyped nil), the row will have a SQL NULL.
Would you say this is expected/desired behavior?


Gists > 1 MB still don´t load!

Hello, I already read https://github.com/mapbox/geojson.io/issues/364 and already tried some tests but geojson.io is still not able to load GEOJSON from Gist > 1MB which are truncated. I am not able load files neither by "Open-Gist" button nor directly by URL. If I copy&paste source manually into geojson.io, then I am not able to save (overwrite) this into the same gist and it creates a new one.  Please help! Example layer: https://gist.github.com/geocentrum1/6162cda1f4102b232511

This is simply a very big file, which is outside of geojson.io's range. Sorry - luckily there are many tools geared toward bigger data, like QGIS.