[bug] All devices but 2 are missing in HA since updating to 1.4.0

Before submitting a bug please read: https://zwave-js.github.io/zwavejs2mqtt/#/troubleshooting/bug_report
Version
Build/Run method

[ ] Docker
[X] PKG
[ ] Manually built (git clone - npm install - npm run build )

zwavejs2mqtt version: 1.4.0
zwavejs version: 6.4.0
Describe the bug
After updating from 1.3.0 to 1.4.0 my devices have a Manufacturer and Product name (which was broken since 1.2.0) but now the devices are missing from HA.
If I remove the integration and add it again, it detects 2 devices (the Z-Wave stick and a powered Fibaro Plug).
All other devices (a bunch of powered/hardwired devices like plugs and switches) and battery devices are all missing.
When I downgrade to 1.3.0 again these immediately show up when I add the integration to HA, albeit with no names/details except for node id's.
To Reproduce
See above
Expected behavior
Manufacturer / product names filled in, all devices in ZW2MQTT available in HA.
Additional context
The issue with Manufacturer/Product names: #673

@syphernl Please attach logs

AFAIK there is a patch needed on hass integration in order to make it working with latest zwavejs version so please wait

AFAIK there is a patch needed on hass integration in order to make it working with latest zwavejs version so please wait

That probably explains this HASS log entry..
2021-02-24 17:57:08 ERROR (MainThread) [homeassistant.config_entries] Error unloading entry Z-Wave JS for zwave_js
Traceback (most recent call last):
  File "/srv/hass/lib/python3.8/site-packages/homeassistant/config_entries.py", line 325, in async_unload
    result = await component.async_unload_entry(hass, self)  # type: ignore
  File "/srv/hass/lib/python3.8/site-packages/homeassistant/components/zwave_js/__init__.py", line 319, in async_unload_entry
    await disconnect_client(
  File "/srv/hass/lib/python3.8/site-packages/homeassistant/components/zwave_js/__init__.py", line 293, in disconnect_client
    await asyncio.gather(listen_task, platform_task)
  File "/srv/hass/lib/python3.8/site-packages/homeassistant/components/zwave_js/__init__.py", line 241, in start_platforms
    async_on_node_added(node)
  File "/srv/hass/lib/python3.8/site-packages/homeassistant/components/zwave_js/__init__.py", line 116, in async_on_node_added
    async_on_node_ready(node)
  File "/srv/hass/lib/python3.8/site-packages/homeassistant/components/zwave_js/__init__.py", line 95, in async_on_node_ready
    for disc_info in async_discover_values(node):
  File "/srv/hass/lib/python3.8/site-packages/homeassistant/components/zwave_js/discovery.py", line 257, in async_discover_values
    and value.node.device_class.generic not in schema.device_class_generic
TypeError: unhashable type: 'dict'


Add the ability to use HTTP/HTTPS proxies on Portainer

Hello dear friends,
I use portainer behind a corporate proxy which is mandatory to access any outside resource.
Thus, portainer is unable to access necessary json file to use App Templates. I can of course host this file locally to fix the problem, but I tend to believe it might not be super hard to add proxy support in one or two requests.
I don't know if proxy could be useful for "endpoint" usage, it's not my usecase. I only use internal servers.
I drop you here a little screenshot of my container logs produced by the missing proxy configuration :

Thanks a lot for the help dear friends!

Makes sense to me to add this.
Rgds,
Neil Cresswell
On 5/01/2017, at 9:32 PM, Jonathan DEKHTIAR <notifications<EMAIL_ADDRESS>wrote:
Hello dear friends,
I use portainer behind a corporate proxy which is mandatory to access any outside resource.
Thus, portainer is unable to access necessary json file to use App Templates. I can of course host this file locally to fix the problem, but I tend to believe it might not be super hard to add proxy support in one or two requests.
I don't know if proxy could be useful for "endpoint" usage, it's not my usecase. I only use internal servers.
I drop you here a little screenshot of my container logs produced by the missing proxy configuration :
[image]https://urldefense.proofpoint.com/v2/url?u=https-3A__cloud.githubusercontent.com_assets_10923599_21673550_c7bf1902-2Dd329-2D11e6-2D9dec-2D8328fba157c3.png&d=DQMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=orw_0jsWUyo2NwweSLUs0z4zvvyIYiKXCyQyzsRCNq4&s=8k-Yfv62UdNIvqfHQRTQfyI7Df-5Y-TrseJi_1CKx0Y&e=
Thanks a lot for the help dear friends!

You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_portainer_portainer_issues_469&d=DQMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=orw_0jsWUyo2NwweSLUs0z4zvvyIYiKXCyQyzsRCNq4&s=F_Qu7bvpsJcW9ADbvtv63Xq6uTpmw9vVFuuWQVL4Py4&e=, or mute the threadhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AWGrldq616nm9J63HgkGsBGq67Nx02Jiks5rPKqRgaJpZM4LbdDZ&d=DQMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=orw_0jsWUyo2NwweSLUs0z4zvvyIYiKXCyQyzsRCNq4&s=0U1A8LAS9uycTxb8LmfZBvQ2dWmxNTaE0QzrqGwANqE&e=.

Same issue here, would love to see this implemented !

Have you tried to add HTTP_PROXY and HTTPS_PROXY env var to portainer container ?
We used that to access external network like github and it works

Tried it ... sometimes it works and I see the "app template homepage" ... sometimes I will get this error. Strange... without restarting the container!
Passed ENV as HTTPS_PROXY=<IP_ADDRESS>:8080
http error: Get https://raw.githubusercontent.com/portainer/templates/master/templates.json: http: error connecting to proxy http://<IP_ADDRESS>:8080: dial tcp <IP_ADDRESS>:8080: i/o timeout (code=500)

I can't really help more, I think you should have same problem from your browser with same proxy

I just tried it now with HTTP_PROXY variable and it works !! Thanks @WTFKr0 for the simple solution I should have thought of that before !
Full docker command :
Replace $PROXY_HOST with the actual hostname of the proxy and $PROXY_PORT with the actual port of the proxy (if present).
docker run \
-p 9000:9000 \
-v /app/docker-volumes/portainer:/data \
-v /var/run/docker.sock:/var/run/docker.sock \
-e HTTP_PROXY=$PROXY_HOST:$PROXY_PORT

@WTFKr0 Nice one ;)
@misery this problem might be related to your network.
@DEKHTIARJonathan want to give this solution a try?

Added via https://github.com/portainer/portainer-docs/commit/078c04ac8eeeeac4d30aa6c3a295c1f23381952e

@deviantony it works perfectly thanks !

Hi Folks,
It is important that this configuration is done using the Web UI. In many cases, the proxy login/password expire after X months, and then it stops working. In the corporate world, this is the default.

I'll re-open to consider an evolution to be able to configure any HTTP proxy inside Portainer.

I would add that, if you corporate proxy has https it is doing it with a internal signed certificate, hence you have to pass the CA to Portainer container so it will not comply about unknown certificate signer. I did it just by passing my /etc/ssl as volume Portainer container (not agent).

@jrbenito makes a good point; in fact it's also necessary in some corporate environments -- specifically those which perform SSL inspection -- to disable strict SSL (i.e. man-in-the-middle attack detection).

The corporate environment with authentication for proxy, here.
I'd really love to have a UI feature to configure the docker registry proxy with credentials.


adafruit_io logging causing halt (in 0.0.8)

adafruit_io upload appears to be causing my grow to halt with a red flashing light. Suspect for some reason it's not handling throttling at the adafruit end (it did before) and returning False, which means that
    if not enviro.upload_readings():
      enviro.halt("! reading upload failed")

in main.py is causing a halt. Could be wrong though!

That's correct, it's alerting you that an error occurred. If it's throttling you need to either reduce your upload frequency, remove some readings, or pay for a Pro plan!

It wasn't doing that before however - it was throttling, but it backed off and tried again rather than halting. It looks like the entire section to handle that situation has been removed;
        if result.status_code == 429:
          result.close()
          logging.info(f"  - rate limited, cooling off for thirty seconds")
          time.sleep(30)
          # try the request again
          result = urequests.post(url, json=payload, headers=headers)

and I think even if that failed it didn't halt.
I should probably point out that I'm using the provisioning defaults for the Grow at all points. I feel that it should be able to handle uploading to one of the default destinations at the defaults rates without having to have a pro plan - that's just going to put users off. I'm going to try reverting to the original adafruit_io.py in the meantime as at least it worked!

@lowfatcode - just also noticed that it now causes a halt if it can't upload for any reason, e.g. the Pico W can't connect to wifi. Does a halt stop any further processing (i.e. does it wake up again in 15 minutes and try again or stay halted)? If so that could be a critical failure - if you're away for two weeks, the wifi glitches for a few minutes two days in and you've got dead plants on your return.
I have altered the new adafruit_io.py to try two more times with 60 seconds sleep inbetween which now seems to be keeping things stable (albeit with one further halt because it couldn't connect to wifi for some unknown reason)  but I feel strongly that this should not be a closed issue - it just does not work as well as the previous version.

Yes, it was backing off before but this isn't a viable solution when on battery power as it substantially increases the drain on the battery - the correct answer is to increase your upload frequency, remove some readings, or pay for pro!
A halt is really just a normal sleep with attached error log entry and blinking red LED to alert the user - so it wakes up again as normal and will actually clear the error (blinking LED) if everything goes OK.

Good news on the halt being essentially cosmetic, that's reassuring! I appreciate that the battery usage of waiting and retrying is higher, but compared to over doubling the number of upload sessions it must be a close thing, especially as I imagine running the pumps is going to swamp usage to some degree . (And yes, there is Pro, but as I say it's a bit of an ask for casual users.)
Probably my best bet is to reduce the number of data points in general (e.g drop luminence and battery voltage, maybe pressure) and upload a little more frequently.

Of course, now I run into another problem which is that the RTC has drifted into the future so I'm getting errors coming back from adafruit.io because there is date being logged that is in the future as far as its concerned - the backing off hid that because by the time it actually uploaded it was in the past! More halts because of it. The ntp fetch is only done if the year has reset, so I've had to alter the code in enviro/init.py so that is_clock_set() only returns true if the year is above 2020 and it's not between midnight and half-past midnight - so hopefully it will sync once (or twice) a day.

@lowfatcode, I think the Adafruit IO upload script needs to revert back to v0.0.2 (or a version similar to v0.0.2) where the script allows for pauses in the upload to reaching the upload limit of 30 data points per minute (for a free account).


As an attendee, I want to be able to chat with the organizer so I can discuss about informations related to the event

User Story Description
As an attendee
I want to be able to chat with the organizer
So I can discuss about informations related to the event
Steps to Follow

[ ] #26
[x] #28
[ ] #29
[ ] #27

Additional Considerations
This might be useful.

Proposed chat process flow
Structure
Each Event has 1 Host and 0 or more Guests.
For each Event, each Host-Guest pair will be assigned a unique socket.io chatroom, specifically for that Event.
Chat history is stored on server and displayed in chat for both Host and Guest.
Both Host and Guest can see each other's in-chat/idle/offline status (i.e. in-chat means whether the person has the chat-window open or not)
Scenarios

When Guest joins Event for the first time, Host-Guest chatroom will be created specifically for that Event. The Guest + chatroom will be added to an Active Guests list.
When Guest leaves Event, the Guest + chatroom will be moved to a Withdrawn Guests list. This list is visible only to Host. Host can  access the chatroom to view chat history, but cannot talk to Guest, since Guest has left the Event.
If Guest rejoins the Event, the Guest + chatroom will be moved back to  Active Guests list from Withdrawn Guests list. Both Host and Guest can now continue to talk to each other.


Testing on Chrome

esting Tile Cache using Browser Stack.
Chrome 23 did not load Tile Chache.
Clients 14 to 18 we had some problem when drawing a bounding box, the viewer would turn a light blue but you could still use the Tile Viewer

Moved Chrome-23 issue to new bug

Can not replicate this problem in Chrome 14-18.  I am able to conduct an ingest, and create a product using a bounding box.  Closing ticket.


possibility to choose for abp or otaa device activation (when registering device)

Hi, is it possible to register device with abp activation mehtod (otaa is set by default)?
I am looking at application.registerDevice() method but it seems to be that choosing activation method is not supported
I don't see it defined DeviceUpdates type which registerDevice() method is using https://github.com/TheThingsNetwork/node-app-sdk/blob/327c3ea997fdbe7f04e832676ae84fb6d83c6d3c/src/applications/types.js#L82
thank you;)

Devices are registered as "OTAA" by default, as in, they don't have a session associated. You can personalize a device to create a new session, i.e. use that session for ABP. It seems that this personalize call is not exposed by the Node.js SDK...


Insta-crash in 10.14.5

I've never tried installing before so this may not be exclusively a 10.14.5 problem...let me know if there's anything else I can do to help troubleshoot!
I have no idea how to parse these crash reports but Termination Reason:    Namespace CODESIGNING, Code 0x1 stuck out to me.
Path:                  /Applications/KnightTouchBar2000.app/Contents/MacOS/KnightTouchBar2000
Identifier:            com.AnthonyDaMota.KnightTouchBar2000
Version:               ???
Code Type:             X86-64 (Native)
Parent Process:        ??? [1]
Responsible:           KnightTouchBar2000 [41125]
User ID:               501

Date/Time:             2019-08-20 20:07:12.280 -0700
OS Version:            Mac OS X 10.14.5 (18F2058)
Report Version:        12
Bridge OS Version:     3.5 (16P5601)
Anonymous UUID:        F0F99031-34FE-FE8A-0E4C-D489DFB35163

Sleep/Wake UUID:       F2B17B2F-5731-4881-AF94-B6297ED75380

Time Awake Since Boot: 5700 seconds
Time Since Wake:       2400 seconds

System Integrity Protection: enabled

Crashed Thread:        0

Exception Type:        EXC_CRASH (Code Signature Invalid)
Exception Codes:       0x0000000000000000, 0x0000000000000000
Exception Note:        EXC_CORPSE_NOTIFY

Termination Reason:    Namespace CODESIGNING, Code 0x1

kernel messages:

VM Regions Near 0 (cr2):
-->
    __TEXT<PHONE_NUMBER>f55000-0000000100f5d000 [   32K] r-x/rwx SM=COW

Thread 0 Crashed:
0                                 	0x0000000105685000 _dyld_start + 0

Thread 0 crashed with X86 Thread State (64-bit):
  rax: 0x0000000000000000  rbx: 0x0000000000000000  rcx: 0x0000000000000000  rdx: 0x0000000000000000
  rdi: 0x0000000000000000  rsi: 0x0000000000000000  rbp: 0x0000000000000000  rsp: 0x00007ffeeecaaba0
   r8: 0x0000000000000000   r9: 0x0000000000000000  r10: 0x0000000000000000  r11: 0x0000000000000000
  r12: 0x0000000000000000  r13: 0x0000000000000000  r14: 0x0000000000000000  r15: 0x0000000000000000
  rip: 0x0000000105685000  rfl: 0x0000000000000200  cr2: 0x0000000000000000

Logical CPU:     0
Error Code:      0x00000000
Trap Number:     0

Binary Images:
       0x100f55000 -        0x100f5cfff + (0) <247B3159-36C6-3833-83BC-D5621A8DBD8C>
       0x105684000 -        0x1056ee6ef + (655.1.1) <C60D7B63-07FD-3108-A878-67706FE90611>

External Modification Summary:
  Calls made by other processes targeting this process:
    task_for_pid: 0
    thread_create: 0
    thread_set_state: 0
  Calls made by this process:
    task_for_pid: 0
    thread_create: 0
    thread_set_state: 0
  Calls made by all processes on this machine:
    task_for_pid: 77547
    thread_create: 0
    thread_set_state: 0

VM Region Summary:
ReadOnly portion of Libraries: Total=640K resident=0K(0%) swapped_out_or_unallocated=640K(100%)
Writable regions: Total=8400K written=0K(0%) resident=0K(0%) swapped_out=0K(0%) unallocated=8400K(100%)

                                VIRTUAL   REGION
REGION TYPE                        SIZE    COUNT (non-coalesced)
===========                     =======  =======
STACK GUARD                       56.0M        1
Stack                             8192K        1
__DATA                             240K        3
__LINKEDIT                         180K        2
__TEXT                             460K        2
shared memory                        8K        2
===========                     =======  =======
TOTAL                             64.9M       11

That's a signing issue. If ever you know how to sign without a paid Apple developer account, let me know.
If you open the project in Xcode and build it yourselves, you will not have the issue.

Let others sign you app is not really a solution ;)

Right, however I don't have any other solution atm.

Hey, maybe you should update your README file. :)
Thank you for this awesome app! :)


Generic Talon files and their Python files should live side-by-side

I would like for knausj_talon to move towards the following organizational principle:

If a Talon file uses abstract actions, there should be a Python file with the same name in the same directory which declares them and describes their intended behavior in a comment.

I've applied this principle to the programming language modes in #652 and #656, and I think it makes the code a lot more readable and discoverable for people who are not already intimately familiar with the code base.
I am opening this issue as a place to have a discussion about this.

I generally agree. I'm not sure how rigidly to apply this principle, but I definitely feel like the weird splitting of some functionality between misc/ and code/ (eg. misc/formatters.talon vs code/formatters.py) is a mistake, and it would be easier to understand/navigate if they were in the same directory.

I'd like to go a bit further and suggest that the text related files should all go in text/. formatters is a good example.

I'd like to go a bit further and suggest that the text related files should all go in text/. formatters is a good example.

Would there be interest in small piecemeal pull requests to reorganize the repository along the lines that I have organized my own repository? See: https://github.com/wenkokke/talon-user
apps/           # contains Talon scripts associated with applications, e.g., Firefox;
core/           # contains Talon scripts which are always running;
tags/           # contains Talon scripts which are activated by a certain tag;
tags/code/      # contains Talon scripts which are associated with a programming language, e.g., Haskell;
tags/code/tags/ # contains Talon scripts which abstract over programming language features, e.g., comments.

I would be happy to submit these piece by piece—or in batches—to help the restructuring.

Yes (or at least, I'm interested), although a lot of bikeshedding is likely to ensue :). We might want to hash out the broad strokes of the reorganization in advance, either in this thread or in a community video meeting. At a glance your repository's organization looks good and thorough but more deeply nested than I tend to like.
If it's just moving files around, and we can get everyone on board with the organization scheme in advance, doing it all at once would be OK, although piecemeal would also be fine and probably easier to coordinate. If you want to change significantly more than file organization it would be good to have a list of the intended changes, and maybe do them PR-by-PR.

I think it tops out at 3 for code/tags/XXX or apps/XXX/platforms?

I'd love to see this change. Happy with the layout you already have personally, but not picky if others want to change things. 3 levels deep is fine by me.

Fixed in #897


Support Cassandra Cassandra <IP_ADDRESS>0?

Hi,
I have two Cassandra cluster installed as below. Does cyanite compatible with both of them?
[cqlsh 3.1.7 | Cassandra <IP_ADDRESS>0 | CQL spec 3.0.0 | Thrift protocol 19.39.0]
[cqlsh 5.0.1 | Cassandra 2.2.3 | CQL spec 3.3.1 | Native protocol v4]

No, Cyanite works with Cassandra starting 3.4.


[Small UI improvement] - Focus text box when renaming a file

When I rename a file it would be amazing to have the text box already focused so that I can directly edit the file name. Right now I need to click on it and then edit it, which is slightly annoying when renaming several files in a row.
Other than that I really enjoy this viewer, thank you for your work!

Good idea. This is now committed at 945dfa5d2813a062a6e9d40700206f29147d3025.
If you are not setup to clone/build post again here and I can attach either a windows zip or deb.

Thank you! I do not have a clone/build setup, so I would not mind downloading the Windows zip.

tacentview_1.0.43.zip
This has the fix. Thx for the suggestion.

Thanks!


Permissions order

Is it possible to retain the order in the permissions files? I organized them alphabetically, but when I added permissions via commands, the order was altered. I can manually edit the files to return them to my preferred order, but I shouldn't need to do. New permissions nodes should be added at the top or the bottom, and the existing entries should not be re-sorted.

No it's not possible.
Permission nodes are stored in "priority order" internally - so that's how they get saved.

thanks for info.


Remove deprecated function from opengl_surface.py

Overview: What does this pull request change?

Remove deprecated function ~.set_fill_by_value() from opengl_surface.py.

Motivation and Explanation: Why and how do your changes improve the library?

The deprecated function never worked in the first place and has been deprecated since v0.16.0.  The function was originally copy and pasted from the Cairo version, which remains in place and does work.
Links to added or changed documentation pages

Further Information and Comments

Reviewer Checklist

[ ] The PR title is descriptive enough for the changelog, and the PR is labeled correctly
[ ] If applicable: newly added non-private functions and classes have a docstring including a short summary and a PARAMETERS section
[ ] If applicable: newly added functions and classes are tested

I would wait with this until we managed to keep up with 3b1b/manim again

I would wait with this until we managed to keep up with 3b1b/manim again

But this was never part of 3b1b/manim, it was something added after that and so removing it would likely make it easier to spot differences with 3b1b/manim.  Or do you have another reason for waiting until we match 3b1b/manim?

I am already working on a PR which ports all the changes and updates from 3b1b/manim and pushing this change would most likely result in github going crazy with code matching because it's a lot of changes

Got it, that makes sense.

Have gone through the changes and decided i doesn't conflict. Thanks for the help!

Have gone through the changes and decided i doesn't conflict. Thanks for the help!


Use input type in coder inference for MapElements and FlatMapElements

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

[ ] Make sure the PR title is formatted like:
[BEAM-<Jira issue #>] Description of pull request
[ ] Make sure tests pass via mvn clean verify. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
[ ] Replace <Jira issue #> in the title with the actual Jira issue
number, if there is one.
[ ] If this contribution is large, please file an Apache
Individual Contributor License Agreement.

It seems that PR #756 triggered some very strange serialization issues with regards to lambda (https://builds.apache.org/job/beam_PreCommit_MavenVerify/2610/console). To isolate them, I went through the conflicts and peeled this commit off the top. Description follows:
Previously, the input TypeDescriptor was unknown, so we would fail to infer a coder for things like MapElements.of(SimpleFunction<T, T>) even if the input PCollection provided a coder for T.
Now, the input type is plumbed appropriately and the coder is inferred.
This required internal changes to explicitly support good display data (tests fail with a naive refactor). While doing this, I just added display data to SimpleFunction by analogy with DoFn.

A bit of flavor on the motivation by this change, which might otherwise look bigger than it needs to be:

ParDo.apply always clones its argument immediately via serialization to support the (very questionable IMO) use case of a user who wants to repeatedly mutate their DoFn while re-using it, and have each of the re-uses keep the value at the time of apply. To me, this contradicts the general semantics of Java...
But anyhow in that case, transient fields end up null so I had to make the types non-transient.
But even though TypeDescriptor is serializable, TypeVariable is not (this is why they were transient in the first place). And this fix is specifically for cases where both the input type and output type contain type variables.
So I "swapped the polarity" on whether the underlying transform stashes a SimpleFunction or a SerializableFunction plus type descriptors.
That broke display data for a minute, since it looked directly at the classes, and in the process of fixing that, I just added display data to the functions. The fix didn't actually require this latter bit.

So this is my best approach to getting a good TypeDescriptor for both input and output without every having to serialize them.

R: @bjchambers AND @swegner

Looks like these same change appears in #756; I've added comments there.

Thanks to your comments in #756, I've fixed this one up. They are now disjoint, but this one will have to merge first.

Aside from comment about additional testing, LGTM

Pinging @bjchambers for binding LGTM

Travis failure is timeout.

Rebased to kick Travis.

Jenkins is red.

Jenkins rightly took issue with a poorly place linebreak. Fixed.

Rebased onto the new DoFn. PTAL.


Add EntityManagerInterface type hint to the EntityRepository constructor

Bugfix for the issue #6021
Cherry-picked commit

@KIVagant I changed the base branch - can you please rebase the PR onto master?

Turns out that this change was already applied to master via https://github.com/doctrine/doctrine2/commit/dbd3fa4501ba062e749c2227bec4ac5934699df5 in #1482. Closing as duplicate.


kicad-unstable: 2020-12-23 -> 2021-04-03

Motivation for this change
Currently the unstable derivation is over three months old.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

did you see  #119986 ?

the 3D models' path changed, i don't think a fresh install of the state offered by this PR would be fully functional


Debian packaging

How to use the ipt debian package:
You can use the debian package of this PR adding this repo:
https://github.com/AtlasOfLivingAustralia/documentation/wiki/Testing-Debian-Packaging#using-demo-repository
and:
apt install ipt

Also you can download the packages manually and use dpkg -i some-ipt.deb:
https://apt.gbif.es/pool/main/i/ipt/
When you install the package it gives you some extra steps to continue:

You can use /var/lib/ipt as datadir.location
Tomcat is sandboxed by systemd and only has write access to some
directories (see /usr/share/doc/tomcat9/README.Debian):

To give access to your IPT data directory, settings have to be overridden.
This is done by creating an override.conf file in /etc/systemd/system/tomcat9.service.d/ containing:

[Service]
ReadWritePaths=/path/to/the/ipt-data-directory/

The service has to be restarted afterward with:

systemctl daemon-reload
systemctl restart tomcat9

This is also commented in the IPT FAQ:
https://ipt.gbif.org/manual/en/ipt/2.5/faq#sandboxing
Original text of this PR
@meshack007 from Tanzania dev team, asked me last Friday for help to install the IPT.
Instead to install it manually I prefered to use:
https://github.com/living-atlases/living-atlases-debianizer
to generate a debian package together, as we were using LXC ubuntu images as containers (and docker cannot run there).
Each debian directory file is commented pointing to some part of Debian documentation or to some man page. Also there is a README with more info about the package.
A summary of how to build the debian package:
sudo apt install debhelper
sudo apt install devscripts
debuild -us -uc -b

We used tomcat8 as dependency because I didn't find jetty-runner or similar already packaged in debian/ubuntu. So it doesn't run like a independent service right now maybe in the future as I did with cas5 debian testing package:
https://github.com/living-atlases/ala-cas-5/blob/debian-package/debian/ala-cas-5.service
I also included in our test apt repository:
https://github.com/AtlasOfLivingAustralia/documentation/wiki/Testing-Debian-Packaging#using-demo-repository
so you can test the install via apt install ipt using this repository.
Some suggestions about apt repositories:
https://github.com/AtlasOfLivingAustralia/documentation/wiki/Testing-Debian-Packaging#create-your-own-apt-repository

Thanks @vjrj
If anyone else would like Debian packages, please comment on this issue. (please comment rather than :+1: and write which institution is interested.)
I won't merge it until there's some demand.  We only have ~8 servers polling the CentOS/RedHat repository, and maintaining (including testing) a Debian package is more difficult for us, since we mostly use CentOS at GBIF.
I also wrote the CentOS build to run within a Docker container, for portability and reliability in any environment. Just debuild -us -uc -b didn't produce a .deb for me, on my Kubuntu desktop.  (Would it be simpler to simply retrieve the built WAR from the Nexus repository? I realize that wouldn't satisfy the Debian package repository's requirements, but I don't know if you were aiming for that.)

About the build, I didn't included the war generation because I usually add a extra deb build step after a jenkins war build job. Also because I'm not sure of your build and release procedure. So please build the war before the debuild command [1].
I recently asked in our small LA community about RedHat/related usage and I didn't find any LA portal using it.
As I mentioned, in Tanzania docker was not an option in that moment.
To package fat wars is common in non official debian packages when their dependencies are not packaged (I can remember openfire chat server package [2], for instance). java is not so easy to package compared to python libs IMHO.
Thanks @MattBlissett
[1] In the case of the la-pipelines debian package, I did this war build conditional:
https://github.com/gbif/pipelines/blob/ala-dev/livingatlas/debian/rules#L23
and I have a extra jenkins job that build it. The packages:
https://apt.gbif.es/pool/main/l/la-pipelines/
[2] see the rules/makefile https://github.com/igniterealtime/Openfire/blob/master/build/debian/rules

I updated this PR to master. Now also do the build and I configured it to use with:
https://jenkins-debian-glue.org/
because I didn't have a job to update the repository.

I've just updated to 2.5.0 running for now in https://ipt-demo.gbif.es/
So apt install ipt installs 2.5.0 now from apt.gbif.es.

I've just rebased this PR  and build/published 2.5.1 debian package. It's running in https://ipt-demo.gbif.es/
I'll update our https://ipt.gbif.es that is running 2.5.0.
So far I detected in 2.5.0:

an error in health check (javaVersion is null for some reason, I didn't find yet the source of the problem).
the login redirects to https://ipt.gbif.es/ipt instead of https://ipt.gbif.es/ This is maybe a proxy issue (we use nginx), but I didn't find a fix yet.

Thanks for keeping this up-to-date.
Is the public URL / baseURL set correctly, and is Nginx changing the path at all? Apache uses the ProxyPathReverse parameter when adjustments are required: https://ipt.gbif.org/manual/en/ipt/2.5/installation#opening-the-ipt-to-the-internet

Thanks for your help!
Our conf:
ipt.baseURL=https\://ipt-demo.gbif.es/

and I checked that page from the IPT manual for setting up our proxies but the nginx equivalent conf
https://www.nginx.com/resources/wiki/start/topics/examples/likeapache/
did not work:
    location / {
        proxy_pass http://<IP_ADDRESS>:8080/ipt/;
        proxy_set_header Host $host;

        proxy_cookie_path ~*^/.* /;
        proxy_set_header X-Forwarded-Host $host:$server_port;
        proxy_set_header X-Forwarded-Server $host;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

    }

I have to do more tests.

For nginx users and login redirect error, because of session.cookie.path:
Changes in /var/lib/tomcat9/conf/server.xml
<Connector port="8080" protocol="HTTP/1.1"
               connectionTimeout="20000"
               redirectPort="8443"
               sessionCookiePath="/" />

and nginx site.conf file:
location / {
        proxy_set_header X-Forwarded-Host $host:$server_port;
        proxy_set_header X-Forwarded-Server $host;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

        proxy_cookie_path /ipt/ "/; secure"; #<--- you need this option

        proxy_pass http://<IP_ADDRESS>:8080/ipt/;
}

I've just rebased this PR and published the resulting 2.5.2 debian package. It's running in https://ipt-demo.gbif.es/
Thanks!

https://www.mnhn.lu is interested in a debian package.

Hi @raffael-mnhn right now you can use it adding this repo:
https://github.com/AtlasOfLivingAustralia/documentation/wiki/Testing-Debian-Packaging#using-demo-repository
and:
apt install ipt

Also you can download the packages manually and use dpkg -i some-ipt.deb:
https://apt.gbif.es/pool/main/i/ipt/

@vjrj it seems that there is only a package for bionic available. I'm on ubuntu focal. Do you expect it to work nonetheless? I'm going to give it a try and report back.

@vjrj The following command also fails
# apt-key adv --keyserver keyserver.ubuntu.com --recv-keys F697D8D2ADB9E24A
I noticed that the key cannot be found on the web service of the keyserver aswell. Maybe it's out of date and was removed.

Hi @raffael-mnhn about 20.04 we used the package in 20.04 too. Sorry this was just a testing apt repo for a debian proposal that we are using it meanwhile.
About using the last version, I installed it in https://ipt.gbif.es but I discover this issue https://github.com/gbif/ipt/issues/1691 (see a fix in the comments). In ipt.gbif.es we are using a local created deb package with this workaround as we were using java 11 in that server. The apt.gbif.es deb package does not include this workaround right now.
So you have two options,

try to use java 8 with the apt.gbif.es published debian package
or to build a deb package with that workaround that works in java 11

About the gpg key you can found it also here:
https://keyserver.ubuntu.com/pks/lookup?op=hget&search=7524d3b383016eab0ee47bfe253a51f7

For those who wonder how to achieve the first solution proposed by @vjrj :
# apt install openjdk-8-jre-headless
# update-alternatives --config java choose version 8
# apt purge openjdk-11-jre-headless to get rid of 11 on the system

Updated to 2.5.4 (security release) and running in ipt.gbif.es.
Thanks @MattBlissett

@vjrj there is another vulnerability in log4j 2.5.4, cf: https://www.lunasec.io/docs/blog/log4j-zero-day-update-on-cve-2021-45046/ and https://www.lunasec.io/docs/blog/log4j-zero-day-mitigation-guide/

The other vulnerability doesn't affect the IPT, as it doesn't use the MDC/ThreadContext feature, and doesn't include the relevant patterns in the logging formats.

@MattBlissett ah, excellent. Thanks for the quick reply. The new vulnerability is also fortunately less problematic.

Thanks to both of you. First news about that new related vulnerability.

@vjrj There is a new version including some log4shell fixes. https://lists.gbif.org/pipermail/ipt/2021-December/000781.html

Sorry, I'm sick and away from keyboard. I'll try to do it ASAP

@raffael-mnhn I've just published 2.5.5

@vjrj I just updated using apt update && apt upgrade and for some weird reason, I had to click though the consent and data directory setup screen afterwards again. I'm not entirely sure if that's an issue with the debian package or maybe I broke something in a config file. Are you sure the package treats the data dir correctly? I guess some of it should be overwritten and some not or maybe interactive merging is necessary depending on the customization that happened to that config file. Anyways, thanks a lot for your great work until now!

I have to setup the data directory manually too because the war deploy clean that file.
If I found time in the future I'll review this part and add some additional setup like language selection.

I just rebased this PR and build the new 2.5.6 release.
I only tested in https://ipt-demo.gbif.es/ and the resources didn't load correctly. I had to update the extensions and install and additional http://rs.tdwg.org/dwc/terms/Occurrence that, for some reason, was not installed.
After restart the resources loaded correctly. ￼cc @mike-podolskiy90
For those upgrading, take special attention to the releases notes:
https://ipt.gbif.org/manual/en/ipt/2.5/release-notes
specially:

Be sure to backup the IPT data directory before performing an upgrade.

Once an IPT has been upgraded to 2.5.6 or later from 2.5.5 or earlier, it will not be possible to downgrade to an earlier version due to changes to the IPT’s configuration files.

Thank you @vjrj

I only tested in https://ipt-demo.gbif.es/ and the resources didn't load correctly. I had to update the extensions and install and additional http://rs.tdwg.org/dwc/terms/Occurrence that, for some reason, was not installed.

After restart the resources loaded correctly

This is because of new Darwin Core stuff. I'm not sure if this always happens on update, but if it does you did right things: update extensions, install missing and restart IPT

No, no, thanks to you @mike-podolskiy90

We have upgraded to 2.5.6 our production ipt without issues.

Wow! Off course!
I was thinking the past week in that, and today I started to think again (after the second request from a node for help to install the IPT in a week).

@vjrj it will take me a few days I think tough. I'll notify you when I'm done.

Don't worry, thanks indeed @raffael-mnhn !

@raffael-mnhn I've just realized that ALA has already an ipt ansible role that can be easily updated: https://github.com/AtlasOfLivingAustralia/ala-install/tree/master/ansible/roles/ipt
With the apt.gbif.es LA repo role:
https://github.com/AtlasOfLivingAustralia/ala-install/tree/master/ansible/roles/la-apt
that includes the ipt deb.

@vjrj I just published the first version of our ansible roles. They include an IPT role. https://github.com/MnhnL/ansible-collection-sidpnat/tree/main/roles/ipt I'm open to suggestions. Maybe it's only interesting for reference.

Sincerely looks great to me @raffael-mnhn . What I had in mind was not so complete :-)
One minor minor comment: you can add the apt repo key like this.

I just published the 2.5.7 debian package and update this PR.

I just published the 2.5.8 debian package and update this PR and our https://ipt.gbif.es .

You should add the repo like mentioned here:
https://github.com/AtlasOfLivingAustralia/documentation/wiki/Testing-Debian-Packaging#using-demo-repository
And later:
apt install ipt

Take into account the comment of the above apt command after the installation (important to allow tomcat to write the ipt data).

I just published the 2.6.0 debian package and update this PR and our https://ipt-demo.gbif.es/ .

I've published the 2.6.1 debian package and I've updated this PR and our https://ipt.gbif.es/ .

@vjrj thanks, I've just updated https://gbif.mnhn.lu without any issues

I've just published the 2.6.2 debian package.

You should add the repo like mentioned here: https://github.com/AtlasOfLivingAustralia/documentation/wiki/Testing-Debian-Packaging#using-demo-repository
And later:
apt install ipt

Take into account the comment of the above apt command after the installation (important to allow tomcat to write the ipt data).

After installing the demo repository and apt install ipt. how to proceed further to complete the installation.

You should add the repo like mentioned here: https://github.com/AtlasOfLivingAustralia/documentation/wiki/Testing-Debian-Packaging#using-demo-repository
And later:
apt install ipt

Take into account the comment of the above apt command after the installation (important to allow tomcat to write the ipt data).

After installing the demo repository and apt install ipt. how to proceed further to complete the installation.

After installing the demo repository and apt install ipt. how to proceed further to complete the installation.

When you install the package it gives you some extra steps to continue. I copy paste:

You can use /var/lib/ipt as datadir.location
Tomcat is sandboxed by systemd and only has write access to some
directories (see /usr/share/doc/tomcat9/README.Debian):

To give access to your IPT data directory, settings have to be overridden.
This is done by creating an override.conf file in /etc/systemd/system/tomcat9.service.d/ containing:

[Service]
ReadWritePaths=/path/to/the/ipt-data-directory/

The service has to be restarted afterward with:

systemctl daemon-reload
systemctl restart tomcat9

This is also commented in the IPT FAQ:
https://ipt.gbif.org/manual/en/ipt/2.5/faq#sandboxing

I've just published the 2.6.3 debian package.

When you install the package it gives you some extra steps to continue. I copy paste:

You can use /var/lib/ipt as datadir.location
Tomcat is sandboxed by systemd and only has write access to some
directories (see /usr/share/doc/tomcat9/README.Debian):

To give access to your IPT data directory, settings have to be overridden.
This is done by creating an override.conf file in /etc/systemd/system/tomcat9.service.d/ containing:

[Service]
ReadWritePaths=/path/to/the/ipt-data-directory/

The service has to be restarted afterward with:

systemctl daemon-reload
systemctl restart tomcat9

This is also commented in the IPT FAQ: https://ipt.gbif.org/manual/en/ipt/2.5/faq#sandboxing

I'm using apache2 now not tomcat. Is that possible to do in Apache. If yes, Please let me know how to proceed.

@vaven7 This is not really the right ticket for general IPT installation support. You should ask in a place that provides IPT support. This conversation should be limited to the debian packaging effort if you ask me.
That being said, you probably need both tomcat9 as servlet container and apache or nginx as frontent.

Hi! We from NDFF ( https://www.ndff.nl/ ) are definitely interested in a debian repository. So please merge!

I've just published the 2.7.1 debian package.

I've just published the 2.7.2 debian package. Thanks @mike-podolskiy90 for release early and release often (*)
(*) https://en.wikipedia.org/wiki/Release_early,_release_often

Hi @mike-podolskiy90 . I have problems building the war of 2.7.3 in my jenkins and intermittently in my computer.
Well, the war is built

but when install the package tomcat9 cannot start it with errors in the war like:

Caused by: java.lang.IllegalArgumentException: The main resource set specified [/usr/share/ipt/ipt.war] is not valid

or invalid Zip:

Caused by: java.util.zip.ZipException: zip END header not found

I have an improved version of this package (with datadir dialog configuration, and eliminating manual steps so migrations are more easy):

but I cannot build well the war and publish the debian package. Have changed something recently in the ipt code that affects the build or maybe I'm missing something?

@vjrj Thank you for your message
Unfortunately, I can't say what is wrong for you right away

Ok, I finally fixed the new build and 2.7.3 is available for install.
As I mentioned, now the package asks for the datadir and persist it between installations, so the previous manual steps (about overriding tomcat systemd config) are not needed it.

I did several install/uninstall/install in https://ipt-demo.gbif.es/ and worked for me.
PS: For using it with ansible you can use something like: https://github.com/AtlasOfLivingAustralia/ala-install/blob/a9bfda7457fef1000fc3ac7865f6cf8d37b958de/ansible/roles/namematching-service/tasks/apt.yml#L1 but using ipt/data-dir key in question.

The 2.7.4 debian version is available for install.
After the last improvements in the package, I've just updated https://ipt-demo.gbif.es/ with a simple:
apt update
apt install ipt

The 2.7.5 debian version is available for install. Just update it with:
apt update
apt install ipt

For some days I published by error the last release candidate of the ipt 3.0-RC1 in our apt.gbif.es debian repository.
If anyone installed it by error, just downgrade it with:
apt install ipt=2.7.5+0~20230823201419.66~1.gbpbb084b
Sorry for the inconveniences. More info in: https://github.com/gbif/ipt/issues/2097#issuecomment-1714031927

The 2.7.6 debian version is available for install. Just update it with:
apt update
apt install ipt

The default install with a directory of /srv/ipt has worked for me on Ubuntu 22.04 LTS (Jammy). What version is Carole using?

I think he tried in 22.04 and 20.04 (and I tried myself in 20.04).

The 3.0.1 debian version is available for install. Just update it with:
apt update
apt install ipt

The 3.0.2 debian version is available for install. I'll publish newer versions silently.


Problem of basecalled the reads

We can get a pass/ file which contain .fast5 files inside after doing nanopore test.
When I want to use this command:
read_fast5_basecaller.py -c r94_450bps_linear.cfg -t 8 -i pass -s basecalled/ -o fastq
I get nothing from the output file -- basecalled/workspace/pass/.fastq and no fastq files in bascalled/workspace/pass/*.fastq inside. How could I fix it ？

Thx!

can  you solve the problem?


feat(create-solid): prompt target if not supplied through args

prompt user for target if they didn't supply one through argv
Disclaimer: I couldn't get the CLI to run locally (pnpm build errors, even tried node cli/index.js and that errored too).

Not sure how you build or run this CLI but this should do it.
ref:

Thanks


Add videos from PyCon CA 2017 #484

@Daniel-at-github sorry about the confusion. I waited a little too long to push this up & then realized you had a PR so I just assumed I was too late to the party.

Fixes #484


Wrong Cover Image

Wrong Cover image is displayed. In screenshot you can see the latest image is not displayed as the cover image.

Enabling Media Retriever will fix this issue but then it leads to issue #32

Issue should be fixed now. It had to do with the albums not being sorted correcly, when items had the same date.
https://github.com/kollerlukas/Camera-Roll-Android-App/commit/dabfdfcf93921a3d1a4fee77fe3c1403bfaad1b2


Support any scheme

Testing #114962
The first time I tried this, I did:
context.subscriptions.push(vscode.window.registerExternalUriOpener(openerId, {
		canOpenExternalUri(uri: vscode.Uri) {
			return vscode.ExternalUriOpenerPriority.Preferred;
		},
		openExternalUri(resolveUri: vscode.Uri) {
			console.log(resolveUri.toString());
		}
	}, {
                // note this
		schemes: ['myextension'],
		label: 'Do the thing'
	}));

Note the scheme.
I then realized it only supported http and https. Why? Is there a technical reason? Supporting any arbitrary scheme makes the code for canOpenExternalUri much simpler because I can say anything with the scheme I care about, myextension:// should be opened with my UriOpener.
If we only support http and https, we might as well just make that the default behavior so schemes doesn't have to be specified. Are there a lot of scenarios where someone would only want to handle http or only https?

This is for future proofing. The limit is (mostly) artificial and in the future we could allow extensions to handle other schemes, such as file or app specific schemes.
I agree it's a little ugly to have both http and https, but I like keeping it explicit and consistent. Also #115168 will help as it makes the supported schemes more obvious

This is for future proofing. The limit is (mostly) artificial and in the future we could allow extensions to handle other schemes, such as file or app specific schemes.
I agree it's a little ugly to have both http and https, but I like keeping it explicit and consistent. Also #115168 will help as it makes the supported schemes more obvious


Add version endpoint to gateway API

What is the expected enhancement?
Provide a new API endpoint to return the version of the quantum-serverless.

Is it good idea to put the version constant in the main/settings.py and return it as the /version api response?  Any opinion? @Tansito @IceKhan13 @psschwei

Yeah, my idea would be to set an environment variable with the version. Version by now is more than enough.

Would it be possible to use that envvar to set the version in all the other various places (such as the image tag)? In an ideal world we wouldn't add another place we have to update when changing versions :smile:

yep, totally

I'll add a global helm variable like this:
# ===================
# Quantum Serverless Info
# ===================
global:
  version: v0.9.0

So any component that needs version can access it.


Ontology

Codecov Report

Merging #50 (61ca5c4) into master (513feb9) will increase coverage by 0.34%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master      #50      +/-   ##
==========================================
+ Coverage   71.65%   72.00%   +0.34%
==========================================
  Files          18       18
  Lines        1263     1268       +5
  Branches      217      217
==========================================
+ Hits          905      913       +8
+ Misses        289      287       -2
+ Partials       69       68       -1

Impacted Files
Coverage Δ

cimsparql/ssh_queries.py
100.00% <ø> (ø)

cimsparql/graphdb.py
92.02% <100.00%> (+0.29%)
:arrow_up:

cimsparql/type_mapper.py
93.25% <0.00%> (+3.37%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Hygieia - jenkins and other collectors not showing up on dashboard

hey, i am in process of setting up the Hygieia dashboard and collectors.
i can get these working -
however i am not able to see any thing on the dashboard from collectors...
http://...:8080/api/dashboard - returning empty - []
i can see in the jenkins collector logs (in debug mode) - the jobs names and etc, however i am not able to understand why these are not showing up in the dashboard.
2018-10-15 17:15:03,509 DEBUG c.c.d.collector.DefaultHudsonClient - buildNumber: 3
2018-10-15 17:15:03,509 DEBUG c.c.d.collector.DefaultHudsonClient - Adding Build: http:///job/wrapper_deploy_docker_st/3/
2018-10-15 17:15:03,509 DEBUG c.c.d.collector.DefaultHudsonClient - buildNumber: 2
2018-10-15 17:15:03,509 DEBUG c.c.d.collector.DefaultHudsonClient - Adding Build: http:///job/wrapper_deploy_docker_st/2/
2018-10-15 17:15:03,509 DEBUG c.c.d.collector.DefaultHudsonClient - buildNumber: 1
2018-10-15 17:15:03,509 DEBUG c.c.d.collector.DefaultHudsonClient - Adding Build: http:///job/wrapper_deploy_docker_st/1/
2018-10-15 17:15:03,509 INFO c.c.d.collector.CollectorTask - Fetched jobs 3s
2018-10-15 17:15:03,552 INFO c.c.d.collector.CollectorTask - New jobs 0 0s
2018-10-15 17:15:03,555 INFO c.c.d.collector.CollectorTask - New builds 0 0s
2018-10-15 17:15:03,558 INFO c.c.d.collector.CollectorTask - New configs 0 0s
2018-10-15 17:15:03,558 INFO c.c.d.collector.CollectorTask - Finished 3s
Please note that i have not set up any ldap authentication, i am using standard authentication post sign up.
sonar collector issue:
018-10-15 17:15:00,252 WARN o.a.h.c.p.ResponseProcessCookies - Invalid cookie header: "Set-Cookie: AWSALB=MLAAhi0tymi5qD+JZmgWXZCasXhU0diqdRDgHHcsA2/C38Kxm8EtbklCVXhk8dDrRSPjVrZJxoZDDGbj1nNK3DAC86FVaCWdKrXT1iTaEmDrjzkAJYe3psBQQstE; Expires=Mon, 22 Oct 2018 06:15:00 GMT; Path=/". Invalid 'expires' attribute: Mon, 22 Oct 2018 06:15:00 GMT
2018-10-15 17:15:00,252 ERROR c.c.d.collector.DefaultSonar6Client - org.springframework.web.client.HttpClientErrorException: 404
2018-10-15 17:15:00,252 INFO c.c.d.collector.CollectorTask - Fetched projects 0 0s
2018-10-15 17:15:00,252 INFO c.c.d.collector.CollectorTask - New projects 0 0s
2018-10-15 17:15:00,254 INFO c.c.d.collector.CollectorTask - Updated 0 0s
Dashboard -
2018-10-15 16:30:35,878 ERROR c.c.d.rest.RestApiExceptionHandler - An Authentication object was not found in the SecurityContext
Really appreciate if someone helps here. tell me where i am going wrong. i have worked on these for the last four days...not able to show data on the dashboard from collectors....

Can you post a screenshot of your dashboard?

Actually nothing is coming in the dashboard. And the sing up is working but
it only shows all dashboard, product and team dashboard options. Below that
there is a create dashboard widget, when I click on that it show different
options, but nothing works. Tomorrow morning when I go to office I can
share more.
From the error or logs what do you suggest?
I have been working on this from the last four days and no luck.
Appreciate your help.
Thanks
Mousom sarkar
On Tue, 16 Oct 2018 at 10:52 pm, Sbrenthughes<EMAIL_ADDRESS>wrote:

Can you post a screenshot of your dashboard?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Hygieia/Hygieia/issues/2500#issuecomment-430207940,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ATlGhiwUUwkt8RPwEkIuPQxJTDgkXBs6ks5ulciIgaJpZM4XdMWe
.

--
Cheers,
Mousom Sarkar

https://github.com/Hygieia/Hygieia/issues/2501 duplicate


Add an option to disable use of bundled LLVM.

Adds an option IREE_BUILD_BUNDLED_LLVM (default ON) which builds LLVM+tools from the in-repo submodule (third_party/llvm-project). When disabled, CMake must be configured such that find_package for LLVM, MLIR, and LLD functions and are at commit levels appropriate.
Re-organizes the LLVM cmake setup to be better contained and normalized vs in-tree/bundled and installed.
Switches MLIR sub-projects iree-dialects, mlir-hlo and torch-dialects to configure from the main IREE build so that they can be used on top of a locally built or installed LLVM.
Updates mechanisms for locating lit so that it is consistent between the two modes.
Moves the binary directory for third_party/llvm-project/llvm -> llvm-project. This means that folks interacting with the bundled LLVM in the build directory will say things like ninja llvm-project/all or ./llvm-project/bin/mlir-opt.
Moves the MLIR sub-projects from under llvm-project/tools/{subproject} -> llvm-external-projects/{subproject} so that it is consistent between bundled and installed modes. Practically, this means that if invoking iree-dialects-opt from the command line, it is in a different place.
Fix to a transform dialect ODR issue which was latent and a namespace conflict with upstream. Not sure what triggered it but put it down to the vagaries of linking.
Fix to the VMVX dependent dialects that came up when building IREE with all backends disabled.

Will follow-up with a script to build various configurations of LLVM/MLIR/LLD so that we can wire it up to CI.

Progress on #12231

Nice, minor nits with caveat that I'm not cmake expert.

I would question the judgement of a person who claimed that title :)

This appears to be breaking Windows post-submit with test failures like this:
C:/hostedtoolcache/windows/Python/3.10.10/x64/python3.exe: can't open file 'C:\\a\\iree\\iree\\build-windows\\llvm-project\\bin\\llvm-lit': [Errno 2] No such file or directory

I expect this is due to https://github.com/iree-org/iree/blob/main/build_tools/cmake/iree_llvm.cmake#L64 (missing extension for Windows).
We may just want to configure it the same as on the installed path (line 87). I'll give that a shot before considering a rollback.


why do we need the worker phase?

using gpt-4 i am able to generate plans that are interdependent as a json that i can immediately execute by looping through them, at this point, we don't need the worker phase right? I can just pass the result of the execution straight to the solver?

Sure, the worker is just a stage for executing those plans.
And since the plans are interdependent, you can parallelize the execution in most cases.
See below for a 8-plan example
https://youtu.be/diJ4IDaT4Z4?t=116

Closing this thread as solved.


Added link to Docker image

Martin's pre-configured Docker image for running LLJVM in a container.

Very cool. Would it take much to make this into an automated build?

It probably wouldn't be a horrible amount of work to make an automated build. But help me understand the benefit. There isn't anything to keep up to date in this case is there? My (admittedly limited) vision is to capture a moment in time, around 2010, when LLJVM development kind of froze and so the pieces aren't changing.
I did debate making an image for hyc's LLVM 3.3 branch, but I'm not sure it would do me personally any good. But if you'd like that, I can do it. I did succeed in building the 3.3 branch after a fair amount of travail.
And by the way, can I just say how great LLJVM is? It exactly solves a problem I have: to take some simple C tools (an assembler, and a PLASMA compiler) and use them within a Java GUI for retro game development (lawlesslegends.com).

As you pointed out, LLJVM's reliance on an ancient version of LLVM has fossilised the code somewhat, and updating it to a more recent release seems more trouble than its worth (although thanks to @hyc for getting it partway there). Docker seems like quite a good solution to that problem, and it would be nice if it could be kept up to date with the current codebase (mostly in terms of minor bugfixes when necessary). Having said that, I'm probably not going to be making any major changes (maybe I'll get around to adding C++ support at some point as I originally intended...) since LLJVM was mostly a fun proof-of-concept for me rather than something practically useful (but it's always good to hear from people actually using it for something :).
Anyway, I'd welcome any pull requests if you did decide to do this, but I understand if you think it's more trouble than it's worth. If you don't, as a starting point, would I be able to get a copy of the Dockerfile you used to build that image?

Hi David,
I may get around to this at some point. I basically felt my way around
until I got a working image, but it wouldn't be terribly hard to reproduce
it in a Dockerfile. Certainly I'd like to support your work and especially
bug fixes (e.g. I noticed that using "inline" in C code crashes the LLJVM
compiler). Can't promise anything as I'm going on vacation in a few days
and everything's stacked up in advance of that.
--Martin
On Sun, Jun 28, 2015 at 8:01 PM, David A Roberts<EMAIL_ADDRESS>wrote:

As you pointed out, LLJVM's reliance on an ancient version of LLVM has
fossilised the code somewhat, and updating it to a more recent release
seems more trouble than its worth (although thanks to @hyc
https://github.com/hyc for getting it partway there). Docker seems like
quite a good solution to that problem, and it would be nice if it could be
kept up to date with the current codebase (mostly in terms of minor
bugfixes when necessary). Having said that, I'm probably not going to be
making any major changes (maybe I'll get around to adding C++ support at
some point as I originally intended...) since LLJVM was mostly a fun
proof-of-concept for me rather than something practically useful (but it's
always good to hear from people actually using it for something :).
Anyway, I'd welcome any pull requests if you did decide to do this, but I
understand if you think it's more trouble than it's worth. If you don't, as
a starting point, would I be able to get a copy of the Dockerfile you used
to build that image?
—
Reply to this email directly or view it on GitHub
https://github.com/davidar/lljvm/pull/5#issuecomment-116399899.

No problem. Thanks again for your contribution, and have a good vacation :)

I tried to use this.
Started a bash:
docker run -t -i mhaye/lljvm /bin/bash

Updated and installed make and patch, and tried to make zlib demo:
apt-get update
apt-get install make patch -y
cd /usr/local/lib/lljvm/demo/zlib
make

It downloads zlib, but it ends failing with a limits.h error.
Full output:
https://gist.github.com/soywiz/cad00018ba48d8ca48d3c132e62cbbd1

I haven't experienced that, but then again I never tried building the zlib demo. Do you have to do the update/patch first?

I "fixed" it commenting out /usr/local/lib/clang/1.1/include/limits.h line 35.
And it seems to compile.
Since it is:
#include_next <limits.h>

Maybe that was because it wanted to include another limits.h in the sample place from other folder. But don't know why.
I had the same issue with other library I tried to compile. So I tested demo folder first.

@martinhaye do you have a Dockerfile for regenerating this? I would want to be able to generate from scratch and to be able to fix stuff when required from the lljvm project.
Right now I'm generating from your repo:
https://github.com/jtransc/java-freetype/blob/master/Dockerfile

Hi @soywiz, unfortunately I don't have a Dockerfile for this. I built it by hand, and intended to make a Dockerfile but didn't get around to it. It's now too long ago for me to remember exactly what I did, I'm sorry.
I'd offer to reconstruct it, but I've changed to using NestedVM for this purpose, to be in line with others on my project. So I'm afraid I can't help out.

Ok. Don't worry, thanks for replying anyway :)
I will try myself, and also I will try again NestedVM! I was not able to compile it.

I do have a Dockerfile for NestedVM. Message me and I'll send you a link. Is there a good public place to put Dockerfiles?

Oh, cool. People usually just create a github repository so anyone can make PRs and so on :)

Done: https://hub.docker.com/r/mhaye/nestedvm/ ... additional testing and PRs welcome. And likewise, if you make a Dockerfile for lljvm I'd be happy to try it out and feedback/PR.


[UBS] - Increase the code coverage of services

As a developer, I want to increase the code coverage of services, so that will help me to change functionality without issues in the future.
AC:

Unit tests for CourierDtoMapper wrote.

Unit tests for EncryptionUtil wrote.

Unit tests for LocationToLocationsDtosMapper wrote.

The classes for coverage can be found in the next folders:

CourierDtoMapper
service/src/main/java/greencity/mapping/courier/CourierDtoMapper.java

EncryptionUtil class all methods
service-api/src/main/java/greencity/util/EncryptionUtil.java

LocationToLocationsDtosMapper
service/src/main/java/greencity/mapping/location/LocationToLocationsDtosMapper.java


BUG: Issue with to_latex and MultiIndex column format. GH8336

closes #8336
This is a potential resolution to GH8336 It borrows the same code flow from _get_formatted_index in
pandas.core.format
import pandas as pd
pd.show_versions()

df = pd.DataFrame({
    "A": [191, 191, 193, 193, 193],
    "B": [1, 1, 2, 2, 3],
    "C": ["foo", "foo", "foo", "foo", "foo"],
    "D": ["bar", "bar", "bar", "bar", "bar"]})

print "\nOutput:"
print df.set_index(["A", "B"]).to_latex()

INSTALLED VERSIONS
------------------
commit: None
python: 2.7.8.final.0
python-bits: 64
OS: Linux
OS-release: 3.17.2-1-ARCH
machine: x86_64
processor:
byteorder: little
LC_ALL: None
LANG: C

pandas: 0.15.1
nose: 1.3.4
Cython: 0.21.1
numpy: 1.9.1
scipy: 0.14.0
statsmodels: 0.6.0
IPython: 2.3.0
sphinx: 1.2.3
patsy: 0.3.0
dateutil: 2.2
pytz: 2014.9
bottleneck: None
tables: None
numexpr: None
matplotlib: 1.4.0
openpyxl: 2.1.1
xlrd: 0.9.3
xlwt: None
xlsxwriter: None
lxml: None
bs4: 4.3.2
html5lib: None
httplib2: 0.9
apiclient: None
rpy2: None
sqlalchemy: 0.9.8
pymysql: None
psycopg2: None

Output:
\begin{tabular}{llll}
\toprule
    &   &    C &    D \\
\midrule
191 & 1 &      &      \\
193 & 2 &  foo &  bar \\
\bottomrule
\end{tabular}

After PR
INSTALLED VERSIONS
------------------
commit: None
python: 2.7.8.final.0
python-bits: 64
OS: Linux
OS-release: 3.17.2-1-ARCH
machine: x86_64
processor:
byteorder: little
LC_ALL: None
LANG: C

pandas: 0.15.1-18-g81c8a5f
nose: None
Cython: None
numpy: 1.9.1
scipy: None
statsmodels: None
IPython: 2.3.0
sphinx: None
patsy: None
dateutil: 2.2
pytz: 2014.9
bottleneck: None
tables: None
numexpr: None
matplotlib: None
openpyxl: None
xlrd: None
xlwt: None
xlsxwriter: None
lxml: None
bs4: None
html5lib: None
httplib2: None
apiclient: None
rpy2: None
sqlalchemy: None
pymysql: None
psycopg2: None

Output:
\begin{tabular}{llll}
\toprule
    &   &    C &    D \\
\midrule
191 & 1 &      &      \\
    & 1 &  foo &  bar \\
193 & 2 &  foo &  bar \\
    & 2 &  foo &  bar \\
    & 3 &  foo &  bar \\
\bottomrule
\end{tabular}

@kotfic can you rebase this and we can get this in.

@jreback Hi,  sorry I lost track of this,  I have rebased,  is there something I need to do to update the pull-request?

@kotfic First, can you try to rebase again? As something went wrong there, making it very difficult to review.
Normally you can just do:
git fetch upstream
git rebase upstream/master
git push -f

and it should be OK.

Secondly, some other needed updates:

Can you add a test for this?
Can you add a small release note in doc/source/whatsnew/v0.16.1.txt?

If you need any help, just ask here! (or at https://gitter.im/pydata/pandas)
cc @hayd

@kotfic can you rebase on master, and squash your commits,
see here for help

closing as stale, but if you would like to reopen and fixup pls do.


38 - Count And Say

Description of the Problem
The count-and-say sequence is the sequence of integers with the first five terms as following:

1

11

21

1211

111221

1 is read off as "one 1" or 11.
11 is read off as "two 1s" or 21.
21 is read off as "one 2, then one 1" or 1211.
Given an integer n where 1 ≤ n ≤ 30, generate the nth term of the count-and-say sequence. You can do so recursively, in other words from the previous member read off the digits, counting the number of digits in groups of the same digit.
Note: Each term of the sequence of integers will be represented as a string.
Example 1:
Input: 1
Output: "1"
Explanation: This is the base case.
Example 2:
Input: 4
Output: "1211"
Explanation: For n = 3 the term was "21" in which we have two groups "2" and "1", "2" can be read as "12" which means frequency = 1 and value = 2, the same way "1" is read as "11", so the answer is the concatenation of "12" and "11" which is "1211".
Code
class Solution {
public:
    string countAndSay(int n) {
        string a = "1";
        string b = a;
        for (int i = 1; i < n; i ++) {
            b = "";
            // current digit
            char c = a[0];
            // how many times this appear
            int cnt = 1;
            int len = a.length();
            for (int j = 1; j < len; j ++) {
                if (a[j] == c) {
                    cnt ++;
                } else { // we have a new digit
                    string tmp = "";
                    // convert cnt to string
                    while (cnt) {
                        tmp = char(48 + (cnt % 10)) + tmp;
                        cnt /= 10;
                    }
                    // add previous digit
                    b = b + tmp + c;
                    // make current digit next
                    c = a[j];
                    cnt = 1;
                }
            }
            string tmp = "";
            // convert cnt to string
            while (cnt) {
                tmp = char(48 + (cnt % 10)) + tmp;
                cnt /= 10;
            }
            b = b + tmp + c;
            // iterative
            a = b;
        }
        return b;
    }
};

Link To The LeetCode Problem
LeetCode

please assign this to me.

Problem already solved! Please ready Contribution Guidelines before creating an Issue/PR


Feature request - display machine groups in all lists

If it's a question of space then I think it's more useful than the serial number which is currently displayed everywhere.

The serial number is a critical part of the listing view. It is needed to properly link to the client tab when the computer's name is clicked.

I see. Well I still wish the Group names were displayed.

You could off course hide the serial number with CSS nth-child


There is no Russian translation

Hello Gregor! I see you made support for the Russian language, but I do not see Json with a Russian translation. Maybe you forgot to add it? Also, json with a Russian translation is not present either in pull requests, or in your commits :(

Hey @ValentinChernyshov, I have been working on the Russian translation and I will add it within the next days.

helo what about this ?

Hey @ValentinChernyshov, I have been working on the Russian translation and I will add it within the next days.

@gregor-doroschenko , if you want, I can help you. Just ask me)

@ValentinChernyshov Hey, sorry about the late reply. I had to go to the hospital for a few days and so I was unable to finish and to add my translation. I already saw that you made a pull request.

@ValentinChernyshov Hey, sorry about the late reply. I had to go to the hospital for a few days and so I was unable to finish and to add my translation. I already saw that you made a pull request.

@gregor-doroschenko ,  I hope you feel good.
Look at my PR, if you have any comments or suggestions - write a comment there)

Thank you for your help! The game is now released in your language :)


Added a basic automation for Youtube

Pull Request Template
script name -youtube.py
What have you Changed
what you changed in the codebase.write here
Added a basic script for Youtube with proper README.md and requirements.txt
Issue no.(must) - #8
Self Check(Tick After Making pull Request)

[ ] This issue was assigned to me.
[x] One Change in one Pull Request
[x] My file is in proper folder
[x] I am following clean code and Documentation and my code is well linted with flake8.
[x] I have added README.md and requirements.txt with my script

If issue was not assigned to you Please don't make a PR. It will marked as invalid.

Hey just remove those linting errors and you're done :)

Yes @pawangeek  working on that .

Hey you can use http://pep8online.com/ for removing flake8 errors

I did Its completely fine and correct . Wait I will do a new PR .


[SPARK-11191] [SPARK-11311] [SQL] Backports #9664 and #9277 to branch-1.5

The main purpose of this PR is to backport #9664, which depends on #9277.

Merged build triggered.

Merged build started.

Test build #45756 has started for   PR 9671 at commit 5502d69.

Test build #45756 has finished for   PR 9671 at commit 5502d69.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/45756/
Test FAILed.

Hm, I suspect maybe the Jenkins build was executed before #9570 (the ADD JAR issue) was merged to branch-1.5, and thus caused the failure.

retest this please

Merged build triggered.

Merged build started.

Test build #45797 has started for   PR 9671 at commit 5502d69.

Test build #45797 has finished for   PR 9671 at commit 5502d69.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/45797/
Test FAILed.

Merged build finished. Test FAILed.

The test failure was because a previous test case (HiveThriftBinaryServerSuite.test jdbc cancel) sets spark.sql.hive.thriftServer.async to false. Haven't looked into why this fails ADD JAR, but I think we can address this issue in a separate PR.

Test build #45930 has started for   PR 9671 at commit fd7cddb.

Test build #45930 has finished for   PR 9671 at commit fd7cddb.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/45930/
Test PASSed.

Merged build finished. Test PASSed.

cc @yhuai

Merge to branch 1.5.

Merged.


Feat(Docat): Add Api to upload project icon

I created this new pull request because I had some trouble with sqashing the commits and switched to a new branch :)
I didn't create a UI for it yet, because of the
upcoming migration to vue 3.
fixes: #75

Would it make sense to add this feature to docatl as well?

@reglim Good idea, docatl should support this as well :)


cmd/test: go test -memprofile outputs a broken profile.

Thanks. Closing as dup.


Linking stations to sites

Hi Tim,
I'm working with Wynand from Arid Lands this week for some training on the ObsDB and we're going through the process of setting up a test weather station. I've noticed some things that I think we can improve.
Firstly, when setting up a Station, the "Station detail" box allows you to link the station to a site. The feature works fine, but other links (to Instrument, Project and Organization) are done with the tabs provided on the background page (not part of the "Station detail" box). This is probably a leftover from how the database was designed, but I think it would be easier to keep track of what has been linked (and where to go to ensure it has) if these are all in the same place. I'd recommend moving the "Site" link to the row of tabs next to  Instrument, Project and Organization if possible. This is obviously not an urgent need, so have a look and see if you agree when convenient.
Secondly, we can link a Site to a Station (as described above), but when we go back to the Sites tab to see one sees a Stations and Organizations tab at the bottom which are supposed to show the links. The Stations tab does not update to show the new link (activated from Sites as described above) and the refresh button only refreshes the list of sites. This keeps the Stations-Site link invisible. If you then click on "Link Stations" the list of options is blank. There are no "Available stations" to select.
Having said that, you can see that the database allows us to link stations and sites in two ways, ie, from the Add Stations "station detail" box and also from the Add Sites page via the Link stations button. Should we eliminate this redundancy?

Hi Abri
The reason for the weirdness with Site/Station is that a Station can only have 1 site, hence the dropdown. The other links are many to many, that is why you can do it from either side.
On the Sites side I will remove the Link Stations button as there are never available stations because Site is required for a Station.
As for the tabs and refreshing, each tab is ignorant of changes in the other tabs. Unfortunately I have no control over that.  What you can do is try close the tab and reopen. Let me know if that doesn't work.


What problem does this feature solve?
打包过程一直卡在64%，没有任何错误信息。具体在building那个文件也看不清。
What does the proposed API look like?
期望能看到错误外的信息，或者能看到当前在building那个文件，或者长时间处于building中报一个错误出来

Can you provide a screenshot of your terminal?


How to format code

I want to format selected code (or auto format after save or after setValue).
The solutions i found is to use indentLine. But when i print the reference of CodeMirror Component, there's no method indentLine.
<CodeMirror
  ref="codeMirror"
  v-model="code"
  :extensions="extensions"
  :tab="true"
  placeholder="Please enter the code."
  style="height: 100%"
  @change="save"
></CodeMirror>

......
console.log(codeMirror)

It seems that this function does not exist in the CodeMirror standard, but it seems possible to do it by implementing the process described on the following site.
https://discuss.codemirror.net/t/adding-indentation/5622/7
In this program, I think you can do this by putting this function in @update.


update readme and description

I was previously working on a similar project: https://github.com/cjbassi/trash-utils-rs until I discovered this one, so I thought I might copy over some things from there.

I'm closing this as I incorporated the changes I found valuable in a recent commit. 9bddccc2e8e368f7278135e60d41da601fa20aa4


更新 BizCharts 地址，Viser 已经没人维护了，去掉

G2 Version:
Platform:
Mini Showcase(like screenshots):
CodePen Link:

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 91.08%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
11836

Relevant Lines:
12493

💛  - Coveralls


Scene graph

What problem does this solve or what need does it fill?
Fast query of objects in vicinity of a given point
What solution would you like?
Octree, quadtree ...
What alternative(s) have you considered?
None
Additional context
I am evaluating bevy for future development that requires performant graphics using wgpu on the web.
An important part of that is proper culling and scene queries to determine visibility and proximity.
Libraries like threejs does not come out the box with such things.
I would like to understand the vision around this for bevy, please.

So, this is a special but very important case of "indexing" (see #1205  and #1587 for some early thoughts): secondary acceleration data structures that make accessing specific entities faster.
The basic design of these in Bevy is:

Create an index, stored in a resource, that records the values of interest, and allows you to quickly look up which entities are relevant. Entity is used as the key here.
Carefully keep this index up to date.
Use the Entity returned by your index to quickly look up the entity in question's components using World::get or Query::get.

Right now, this basically works: you can implement this yourself with whatever index you'd like to make things faster. However, steps 1 and 2 are manual (and users can create frustrating data desynchronization bugs due to lack of atomicity), and step 3 could be optimized further (see #2965 for example).
To improve the difficulties around 2, the informal ECS team has been working on designs towards a permissions model of data access, to ensure appropriate atomicity of transactions. See #2801 (and ask onthe #ecs-dev channel on Discord) for some very early thoughts on that.
Once that's firmly in place and a good extensible API is ready, we can begin the work of baking in and optimizing several common indexing strategies into Bevy itself, making it fast and easy for users to accelerate their lookups in this way,.

It sounds like there is still a lot of thought, design and works to be done in this space.
Is there any hard targets (version number) for these kinds of optimizations or is it still a bit shoot from the hip?
I am very excited about the future of Bevy but it is hard for me to guage the future facing feature timelines.
Either way thank you for the feedback it is much appreciated

Is there any hard targets (version number) for these kinds of optimizations or is it still a bit shoot from the hip?

No hard targets; we're limited to one paid full-time dev (Cart) right now, so progress is fairly organic and we've been focusing on polish for one major feature area per release. Completely unofficially, this work is likely to happen on the side by the ECS team over the next 6 months to a year.
For now, rolling your own index and manually updating it should get you the performance you need, and debug asserts will help dramatically with safety.


Mark done

Allow the user to select and delete/done notifications with ctrl-x.
I changed individual Done to ctrl-x and comment to ctrl-c. Not sure about what are good keys for that.
in continuation of https://github.com/meiji163/gh-notify/pull/90.

rebased

Comment to ctrl-c.

⌃ Control + C is typically used for canceling. Set it to ⌃ Control + O for now.

Done to ctrl-x

Okay.

The issue is that there is no done field, as mentioned in the referenced issue. Therefore, I won't merge it for now unless GitHub adds this feature or @meiji163 also desires this feature.

https://github.com/meiji163/gh-notify/issues/47#issuecomment-1974962747

@LangLangBart I see your point. Responded in the #47 (https://github.com/meiji163/gh-notify/issues/47#issuecomment-2245257923).


Harmony: remove local state from AutoComplete

PR includes

[x] Bug Fix
[x] Refactor

Related issues
Resolve #952
QA Instructions, Screenshots, Recordings

/canary

/canary

/canary


enable basic obfuscation

This defines MESSAGE_VERSION version 3. When a remote peer running this version is encountered, (basic) obfuscation will be offered to them. Older clients will be unaffected.
Tested locally, in the network lab, and across the real internet with a mix of Chrome and Firefox -- but of course we should exercise this quite a bit during the next testing party. If we can't tell the difference during regular browsing, I think we're good to go.
One note: if you experience difficulty establishing a connection in the office, edit your advanced settings to include only stun.l.google.com. This only affects the office and we're working on a fix. Of course for any real testing we should be using real home internet and/or mobile connections!

FYI, this considerably reduces the length of one-time connection messages: (from >2000 to <1000 - more discussion on https://github.com/uProxy/uproxy/issues/1490).
Right now, I haven't considered one-time connection backwards compatibility too much. Perhaps we should discuss this Monday.

:+1:


K3s/Flannel? - Pods slow to establish TCP connections

Environmental Info:
K3s Version:
1.26.4

Node(s) CPU architecture, OS, and Version:
AMD x86_64, AWS EC2 m5.2xlarge, 5.10.167-147.601.amzn2.x86_64

Cluster Configuration:
Single node, cluster created using k3sup

Describe the bug:
TCP Connections between pods in the cluster take a long time to establish, however once established become fast. Example being a database connection taking several retries to connect successfully (the database running in the cluster as well) but once its up the queries happen quickly.
I have done some debugging and by tcpdump'ing cni0 I can see that almost all UDP and TCP packets that are coming into the interface have incorrect checksum errors. Not sure if this is a symptom or the root cause, looking online at flannel it seems like there have been issues in the past when offloading checksum calculations to the NIC, I tried turning off tx-checksum-ip-generic with ethtool as suggested in them posts but got nowhere.

Steps To Reproduce:

Provisioned EC2 instance as described above
Execute k3sup to install k3s
Installed K3s with the following flags:
--disable traefik, (set of OIDC flags for kube apiserver), --secrets-encryption

Expected behavior:
TCP connections establish quickly between pods in the cluster.

Actual behavior:
TCP connections take a long time to establish requiring several retries.

Additional context / logs:
As mentioned I have looked through a lot of information about flannel already to try and debug this but cant workout why I am seeing what I am seeing.
Here is a screen capture of tcpdump output:

I can do some hacky grepping and see that some checksums are correct:

I have no idea if this is the cause of the issue or a symptom of some other misconfig.
I have also tried host-gw backend and see the same.
Thanks!

I am going to try and use the new Amazon Linux 2023 when I get home as it uses linux kernel starting at 6.1.
Will update.

I have tried the newer operating system but got the same issue, just need someone to confirm that these checksum errors are expected on the cni0 interface, if they are I will move on!

I have confirmed the issue here is not with k3s or flannel, closing.


Add in internet gateway support

Add in internet gateway support; closes #512

Oh! Don't forget to add an index on id: https://github.com/lyft/cartography/blob/047a6bd1820e846e70bda4c6ddc18027da39e20a/cartography/data/indexes.cypher
If there is enough data, queries on nodes without indexes may take days to finish and have unpredictable behavior - see https://github.com/lyft/cartography/pull/505.

Thanks for putting out a really slick tool! Happy to contribute

@achantavy - I think I've addressed all of the issues, let me know if you have additional feedback!


Design detail pages

Current detail pages are just like the inputs. Potentially something like how Services detail pages look.

[ ] Secrets
[ ] Config Maps

Creating separate tickets for each of these.


[WIP] fix au/tas/launceston

second try to fix up au/tas/launceston, if it works replaces #3963

unit, number, city, region, postcode look good, just street which is wrong.

Any updates here?

Any updates here?

No I haven't had a chance to take another look.

closing in favour of #5836


Many samples won't load on the Monaco website

Open the Monaco website.
Click the 'Language' combo box.
Select 'Rust'.
You'll now see an error that says "Failed to load rust sample".

There is an error in the console.
index/samples/sample.rust.txt Failed to load resource: the server responded with a status of 404 ()

Rust support was added in Microsoft/monaco-languages#31 but it seems like the website isn't quite right...?

I have found that there are many other samples that won't load.

csp
mysql
pgsql
redis
redshift
sb

Yes, these languages were added to monaco-languages but then we forgot to add a sample in https://github.com/Microsoft/monaco-editor/tree/master/website/index/samples
If you have some time, PR welcome! :heart:


scipy.linalg.orthogonal_procrustes

Most of the linalg decomposition functions are correctly set up to work with complex matrices (like svd, qr).  However, orthogonal_procrustes is not.   It needs an extra conjugate on the matrix A to be correct for the unitary procrustes problem.   The existing function could either be modified (which would not break anything for real matrices), or a new function like this could be added.
def unitary_procrustes(A,B,check_finite=True):
  # Given matrices A and B of equal shape, find a unitary matrix R that most closely maps A to B (AR should be close to B)
  # This only differs from orthogonal_procrustes by np.conjugate(A) in the first line.
  u,w,vt=np.linalg.svd(B.T.dot(np.conjugate(A)).T)
  R=u.dot(vt)
  scale=w.sum()
  return R,scale

Seems like a sensible addition though the name would be wonky a bit. I don't think this needs yet another function since it is basically an SVD call and another one-liner.
Also the code can be cleaned up for Py3. Care to send a PR?

What py3 changes are needed?

@ for matmult and the future imports at the top specifically.

I don't think this needs yet another function ...

@ilayn, does that mean you are suggesting that the conjugate call be added to the existing function in the appropriate place rather than creating a new function?  That makes sense to me, since conjugate is just the identity with real matrices.  The docstring should also be updated to mention that complex inputs are handled and the result in that case is the solution to the unitary Procrustes problem.
This would be a change in behavior for anyone who currently calls the function with complex inputs, but I think we can interpret the current behavior with complex inputs as a bug, and adding conjugate is a bug fix.
(At the moment, I'm also assuming that this is, in fact, the correct fix.  It seems reasonable, but I've never thought about unitary Procrustes decompositions.)

... and removing the future imports at the top specifically.

Those imports have already been removed in master: https://github.com/scipy/scipy/blob/master/scipy/linalg/_procrustes.py

does that mean you are suggesting that the conjugate call be added to the existing function in the appropriate place rather than creating a new function?

Yes, and I agree with your doc change. To me still the whole function looks a bit redundant but it is what it is I guess.

(At the moment, I'm also assuming that this is, in fact, the correct fix. It seems reasonable, but I've never thought about the unitary Procrustes problem.)

Yes the definition of the problem is different but the maximizer value and hence the machinery is the same.

Those imports have already been removed in master:

Ah clicked the wrong link. Good catch.

@keithbriggs it looks like you did this on your own fork instead of submitting a PR to SciPy, are you still interested in submitting a PR?

Yes, I thought I had done that. If not could you please advise the procedure?

You can:

Clone the current repo for scipy, or update your own;
Set up your remotes (usually, we use origin for your own fork and upstream for the scipy main repo)
Create a feature branch with git checkout -b branch_name
Do your changes
Push them to your own fork by doing git push origin branch_name
Either click the link that shows up in your terminal or visit your fork at https://github.com/keithbriggs/scipy and there will be a prompt at the top of the repo about creating a pull request for the scipy master branch.

Hope this helps! Feel free to ping otherwise :)

Thank you very much - I will try this on the weekend.

Closed by gh-12071.


Add merge-args from pypi

:-( This is too much work for a simple dependency. Closing this PR in frustration and reopening later if I feel like jumping thhrough these hoops.


Fixed bug with date and date time widgets where you cannot reenter without moving away

Fixes: #208

This is excellent! Thanks for the fix!
Can you just do the same in https://github.com/google/android-fhir/blob/master/datacapture/src/main/java/com/google/android/fhir/datacapture/views/QuestionnaireItemDateTimePickerViewHolderFactory.kt?
I will approve after that.

Please feel free to merge once the tests pass.

@jingtang10 1 check is failing and I am not able to interpret the reason for it's failure. Can you check?

tests passing now -- please feel free to merge your first PR! 🎉

Only those with write access to this repo can merge PRs. There doesn't seem to be an option for me to merge the PR.

Merged it for you Varun -- and thanks for your contribution. If you're looking to contribute regularly I will add you as a collaborator thanks!

Merged it for you Varun -- and thanks again for your contribution. If you're looking to contribute regularly I will add you as a collaborator thanks!

Sure, I'd love that.


Update PostCSS dependency to 6.0.x

PostCSS is now up to v6, and issues warnings when used with -conditionals:
Your current PostCSS version is 6.0.1, but postcss-conditionals uses 5.2.17.
There seem to be some breaking changes - having updated the dependency version, npm test fails on 55 tests. It seems like the only difference is whitespace though.

@andyjansson ?

@evgenyrodionov I'm away this week. I'll update this, as well as my other repos in the coming week.

@bbodien @evgenyrodionov I've updated the dependencies as well as rewritten the library in ES2015. I've yet to publish it to npm. Given it's a rewrite it could stand some additional testing before going live. It's available in the repo if you want to test it.

Thanks for updating this. I installed the updated version from the repo, and it doesn't work. I'm using postcss-cli, and I just have it in a config file. postcss-cli gives me the following error:
Error: Failed to parse "/Volumes/Drobo/Personal/Code/thearsse.com/postcss.config.js" as JSON, JS, or YAML.
    at /path/to/node_modules/cosmiconfig/lib/loadDefinedFile.js:26:13
    at <anonymous>

My postcss config is thus:
module.exports = {
    plugins: [
        require('postcss-conditionals')()
    ]
}

It's the same error I'd get if I'd put garbage in the require, so it's not loading anything. Is there something else I need to do?

Hi @dustinwilson
It would look that installing postcss-conditionals that way produces an empty directory because the dist folder where the compiled code is housed doesn't exist, and anything else gets wiped per package.jsons files declaration.
For your convenience I've published the package to npm as a prerelease. You can install it with the following command:
npm install postcss-conditionals@next

@andyjansson Works great now, thanks!

@dustinwilson awesome! :smile:


Grafana dashboard update for release-0.1

Grafana dashboard update from upstream + backport of local jsonnet dependency.
Follow-up of https://github.com/kubernetes-monitoring/kubernetes-mixin/pull/269

Thanks! Lgtm


webhooks/taiga: Stop using emojis in notifications.

A lot of the emojis were not getting displayed. When I tried the payloads generated through Taiga in my local zulip terminal.  Here is a screenshot that reciprocate the same.

I updated the unicodes for the emojis that were not working. I did this in the view.py file. I also tried created some fixtures by generating payloads and then testing it on my local enviroment. After the change, it looked like this.

@eeshangarg Please review the PR.

@sameerchoubey thanks for working on this!  I'll wait for @eeshangarg to review.
Do you think the emoji improve this integration's output?  Because the other option is to just remove them to decrease maintenance burden.

@eeshangarg I've updated the codebase and removed the emojis notification. Please review.

@eeshangarg All done. Test passing on localhost development server. Please review.

@eeshangarg I've updated the commit message and have also rebased my branch. So, it should be ready to get merged now.

Looks great, merged, thanks @sameerchoubey!


HDDS-8186. ozone sh key put does not work in single-datanode compose example

What changes were proposed in this pull request?
The documentation has instructions to create a single DN node Ozone docker environment. But, key create commands fail because server-side default replication config is RATIS THREE.
We set client replication config to 1 in client configuration in the docker environments. Also, set the replication type to RATIS so that keys can be created with RATIS ONE replication type in a single DN setup.
What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-8186
How was this patch tested?
Manual.
Follow documentation to spin up a docker cluster.
Run
ozone sh volume create /vol1
ozone sh bucket create /vol1/bucket1
touch /tmp/myfile
ozone sh key put /vol1/bucket1/key1 /tmp/myfile

Thanks @SaketaChalamchala for updating the patch.  I think it does what is intended.  However, it uncovered a bug in Ozone CLI related to EC (HDDS-9035), which I'll need to fix before this can be merged.  I'll mark this as draft until then.

@umamaheswararao please review

An improvement here could be to read value of --scale and set the config. I'm not sure if this is possible but just a suggestion.

I don't think this can be done @sadanand48 . To use RATIS THREE you would have to do
OZONE_REPLICATION_FACTOR=3 docker-compose up --scale datanode=3 -d


Snippets

Everything is just great.
The only thing missing is snippets.

I haven't found many LSPs supporting snippets. Are you requesting built-in snippets for things like loops and stuffs or do you want to be able to define custom snippets? What language are you using? Can you provide more information on how would you want it to behave or some demonstration using other editor? I think this is something it can be added without much work, but I never used them so I'm not very familiar on how people tent to use them. Thanks

I use snippets to insert my own code snippets. I am completely satisfied with the snippet system in the Vim SnipMate plugin. But to be completely honest, the most convenient implementation of the snippet system that I have met is present in the RJ TextEd editor.

Yep, snippets would be great. I am very used to snippets from SlickEdit. Here is roughly how they work there:

The user can define their own sections of text, as short or as long as they please. In SlickEdit they can be set up on a per language basis. So e.g. a snippet for seeding a new file could always have the same name (alias), but there would actually be different text for different languages.
Each snippet is associated with an 'alias'. That is a code word to be typed in the source code. When the space bar is pressed with the cursor located just after the alias and the alias being the last piece of text in the line, the snippet will be inserted. So snippet insertion is in the flow of typing. If the alias happens to be embedded in text (not at the end of a line) then a hotkey press is required.
Snippets can have embedded keys to be expanded upon insertion. For example a date, time, file name and various other things can be automatically expanded upon insertion.
Snippets can have embedded variables. If a variable exists in the snippet, a dialog will open upon insertion to allow typing in values for each variable. These will then be replaced in the snippet before insertion.
Snippets can contain control codes to control behavior. E.g. move the cursor to the start of the line or to a specific column before insertion, place the cursor at a specific location when done with the insertion, etc.

I use this extensively for starting new files, the insertion of function headers, if/else control blocks, switch/case, loops, comment clocks, etc. etc.

BTW, Cuda Text offers similar functionality as well. It's actually quite common now.