armTrustedFirmwareRK3399 (misc/arm-trusted-firmware/default.nix): incorrect license, should be unfreeRedistributable

Describe the bug
arm-trusted-firmware has the wrong license when built for RK3399.
This file is a binary with no source code.  This is not peripheral firmware (lib.licenses.unfreeRedistributableFirmware) -- the binary file in this package is code that runs on the main CPU (at a privilege level even higher than the kernel or hypervisor!).
Although the name implies that it ostensibly has something to do with HDCP, there is no way to verify that it does not perform other functions.  It is also impossible to audit it for security to ensure that it cannot be exploited.  Remember, this code runs on the main CPU in EL3, above the kernel.
One possible resolution is to excise the blob from the firmware, like vinceb does in this patch
Steps To Reproduce
Steps to reproduce the behavior:
nix-env -iA armTrustedFirmwareRK3399

ping

I have submitted two PRs; merging either one of this will fix the issue.  There is no need to merge both.

I don't think the BSD license actually does require the distribution of source code, so it could be correct that the binary blob is being licensed in the upstream repo under BSD-3.
AIUI: BSD-3 is very lax and doesn't do a whole bunch beyond permitting end-user redistribution - it doesn't require that source code is distributed alongside, or that you will actually even be able to install the modified binary (although you are permitted to modify it and distribute it).
Do you have a statement from upstream that this file is not intended to be considered as licensed as BSD-3?

I don't think the BSD license actually does require the distribution of source code, so it could be correct that the binary blob is being licensed in the upstream repo under BSD-3.

The nixpkgs license field refers to the licensing terms of the source code of the relevant package.
If this were not the case, then licenses.nix would need to set unfree="true" for the BSD license, since binaries without source code do not meet the definition of free software.  This is, of course, ridiculous.  It should be obvious that the intent of licenses.nix is to describe the license of the source code for the package.

Replying first:

It isn't a philosophical change; it corrects an oversight to bring licensing in line with longstanding policy.

When I said change here in this context, I meant "the combination of both of these PRs" or "this issue". Given you've opened two separately PRs for this I want to avoid copying and pasting the same messages twice in both places and splitting the conversation... which you've already ended up doing, by replying with the exact same message (+ a bit in one of them) in both places.
Overall though, yeah, I think that's probably a reasonable stance to take. meta.licenses can't really encode the nuance that we would need to make this work well to encode what everyone is looking for.
I think the right thing to do in this case is:

Add a new parameter to the package (unfreeIncludeHDCPBlob ? true, or similar?)
If it's false, apply the patch to drop the blob.
If it's true, don't apply the patch, and add unfreeRedistributable to the list of meta.license. The argument you make that this shouldn't be considered unfreeRedistributableFirmware since it's a blob that runs on the CPU at high PL is probably reasonable.

That's the best compromise, I think: people who haven't opted in to nonfree will get told at buildtime that they're pulling in something they might not like (and they can opt out of the feature using an overlay), and we don't lose the functionality for people relying on it.
I specifically think this way around is better than flipping it off by default because it means that it's much more noticable that you can't build and need to flip a flag - since it'll fail noisily and obviously - than it is to have some functionality missing, but WDYT?

I want to avoid copying and pasting the same messages twice in both places and splitting the conversation... which you've already ended up doing, by replying with the exact same message (+ a bit in one of them) in both places.

Sorry about that.

Overall though, yeah, I think that's probably a reasonable stance to take. meta.licenses can't really encode the nuance that we would need to make this work well to encode what everyone is looking for.
I think the right thing to do in this case is:
1. Add a new parameter to the package (`unfreeIncludeHDCPBlob ? true`, or similar?)

2. If it's `false`, apply the patch to drop the blob.

3. If it's `true`, don't apply the patch, and _add_ `unfreeRedistributable` to the list of meta.license. The argument you make that this shouldn't be considered `unfreeRedistributableFirmware` since it's a blob that runs on the CPU at high PL is probably reasonable.

That's the best compromise, I think: people who haven't opted in to nonfree will get told at buildtime that they're pulling in something they might not like (and they can opt out of the feature using an overlay), and we don't lose the functionality for people relying on it.
I specifically think this way around is better than flipping it off by default because it means that it's much more noticable that you can't build and need to flip a flag - since it'll fail noisily and obviously - than it is to have some functionality missing, but WDYT?

I agree with all of this.  I will update my patch to implement this approach later tonight.

I have pushed a commit which implements @lukegb's idea at #158309; let's continue the discussion there.


Not working for any website

Not working for https://seriehd.moda or https://piratestreaming.surf/, i have latest version of code

the first one is protected with captcha for me.
but test is successfull for the second one, you can view my output here https://pastebin.com/XJ93iNMe

yes, but don't return the HTML page to me

download the archive and update a whole code, it should work

@WAVDEVTEAM
Try this commit:
https://github.com/KyranRana/cloudflare-bypass/tree/4e7a6f57df9884e450e7e02ef067425cc1f8801d


Origin header is not set to WebSocket when SIP.js is used from node server

Could you add a possibility to specify Origin header for WebSocket  creation, when SIP.js is used from node server? Out of the box, ws module does not set Origin header and there is no way to overcome this problem, unless you specify options when you call new WebSocket constructor.
In our setup we were able to resolve this by fixing the following line in the sip.js
this.ws = new WebSocket(this.server.ws_uri, 'sip', {origin: 'foo'});
Obviously, this is not the right way to do this, so it would be nice to have a possibility to provide web socket options as a configuration part of the SIP.UA constructor

Hi @vkuzmenok,
We are currently working on a way to make the transport layer more generic and editable, similar to what has occured with the session description handler. I am not sure if that will be in the upcoming release, but it should be in soon after, and at that point this should certainly be possible.
Thanks,
James

Thanks James.
Do you have a timeline when you expect next releases to come out?
Vladimir

The next release will be in the next week or two, if all goes as planned. I am not certain on the following release, but once the work in question is done it would release.

Does this mean, you will provide an option to specify the transport in the UA contructor?

That is the plan. Should be extremely similar to how you can specify your own Session Description Handler.

Sounds great! Thanks!

An update on this: the 0.11.0 release represents a huge refactor for the transport code- with the purpose of making this type of thing a lot easier. The UA now has a configuration parameter transportConstructor where you can give it a user-defined Transport (as @egreenmachine said). For this case it should be 99.9% a copy/paste job from the default websocket transport, where you'll be adding an extra argument to the new Websocket call and an additional configuration parameter on the new Transport you define. This might seem like overkill- to create a whole new file just for this one simple change, but it allows us to not have to support the nonstandard API while also giving you the flexibility to have the functionality.
As always, if you need help we have a mailing list that gets checked frequently.


Tweaked Telegram configuration docs and added an explicit error on message failure

Added printing an explicit error in case of Telegram misconfiguration
Amended sample_config.yaml to highlight a possible point of failure
Great project overall, just had to spend a significant amount of time figuring out why topics and messages were not mirroring correctly due to the error being silent

@akshettrj The Telegram API was responding with "Bad Request: chat not found", because I've copied the chatId from Telegram Web as is without adding the "100" prefix of a supergroup


Reorganize builtin

Directory builtin reorganized to

make as much use as possible of builtin.h  and .c generated by compiling builtin.act
eliminating list_imppl.c, dict_impl.c and set_impl.c which are legacy file since the time before protocols.

Files builtin.h and builtin.c are now to a large extent the ones generated by actonc when compiling builtin.act. Differences are marked in the files; things that will not be used are commented out but left in the file. This is mainly

everything having to do with Env, which is defined in builtin.act, but has separate env.h and env.c files in builtin (mainly generated by actonc at some earlier stage, so there are some differences compared to what we have commented out now)
implementations in builtin.c of methods for builtin types which use struct fields which are not visible in builtin.act.

There are some other small things:

some _new methods are not generated by actonc. I have manually added  B_HashableD_intG_new, B_ContainerD_listG_new and B_HashableD_strG_new, but there may be others that should be added but are not used in tests.
B_print has a tuple as argument but the code generator generates code as if it had varargs parameters.
The method B___init__() in builtin.c omits some field initialisations. I have not tracked all manual changes I made here.
the test test/core_lang_auto/instantiate_abstract_class__bf.act should give a compilation error, but does not. I have introduced a syntax error so that ‘make test’ will succeed and I can merge with main…

Wow, good job! :tada:


build-azure-win2012r2-x64-2 is having a connect issue.

jdk-windows-x64-openj9
https://ci.adoptopenjdk.net/view/Failing Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-openj9/2/console
Again it seems network issue
05:15:58  ERROR: Build failed for targets 'product-images legacy-jre-image test-image debug-image' in configuration 'windows-x86_64-server-release' (exit code 2)  05:15:58  Stopping sjavac server 05:15:59   05:15:59  === Output from failing command(s) repeated here === 05:15:59  * For target jdk_modules_java.compiler__the.java.compiler_batch: 05:15:59  [stderr] java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72fb5619[Not completed, task = com.sun.tools.sjavac.comp.PooledSjavac$$Lambda$41/0x00000001000be840@76c4dc19] rejected from java.util.concurrent.ThreadPoolExecutor@37f9d622[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 6] 05:15:59  [stderr] 	at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2057) 05:15:59  [stderr] 	at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:827) 05:15:59  [stderr] 	at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1357) 05:15:59  [stderr] 	at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:140) 05:15:59  [stderr] 	at jdk.compiler.interim/com.sun.tools.sjavac.comp.PooledSjavac.compile(PooledSjavac.java:61) 05:15:59  [stderr] 	at jdk.compiler.interim/com.sun.tools.sjavac.server.IdleResetSjavac.compile(IdleResetSjavac.java:70) 05:15:59  [stderr] 	at jdk.compiler.interim/com.sun.tools.sjavac.server.RequestHandler.run(RequestHandler.java:104) 05:15:59  * For target jdk_modules_java.datatransfer__the.java.datatransfer_batch: 05:15:59  Connection attempt failed: Connection refused: no further information 05:15:59  Connection attempt failed: Connection refused: no further information 05:15:59  Connection attempt failed: Connection refused: no further information 05:15:59  Giving up 05:15:59  IOException caught during compilation: Could not connect to server 05:15:59  * For target jdk_modules_java.xml__the.java.xml_batch: 05:15:59  Connection attempt failed: Connection refused: no further information 05:15:59  Connection attempt failed: Connection refused: no further information 05:15:59  Connection attempt failed: Connection refused: no further information 05:15:59  Giving up 05:15:59  IOException caught during compilation: Could not connect to server

@Willsparker Could you take a look at this? It may just be an obvious network issue

https://ci.adoptopenjdk.net/view/Failing Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-openj9/3/console
https://ci.adoptopenjdk.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-hotspot/609/consoleFull
https://ci.adoptopenjdk.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x86-32-hotspot/607/consoleFull
It appears the machine was okay last night - I think the initial issue was a one-off :-) Closing, happy to reopen if it recurrs


Update cleanmymac to 3.8.3,1495454514

After making all changes to the cask:

[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} reports no offenses.
[x] The commit message includes the cask’s name and version.

Thank you for the contribution. It was merged directly as 197c4ee27ba7c1a4d4e2757706d914df22d61867. Your contribution is still credited to you.


Proper documentation for defunct devex_badge() function?

We decided to skip deprecation/defunct documentation for the changes in bcgovr functions, given that bcgovr functionality is fully interactive, or is intended to be. With test driving, I have realized that we have devex_badge() scripted in almost every EnvReportBC repo.
Given this, and that perhaps others have used this function in the same way, I suggest we add in either a defunct error message, or keep devex_badge() with a deprecation message to now use insert_bcgov_devex_badge()?

Oh good idea! I vote for the latter (still works with a deprecation message) to give ourselves a bit of time :)

I like time ⌛!

bcgovr::devex_badge works again with deprecation warning. After reviewing the rest of the interactive functions—and :thinking:  about it again—I don't think the defunct.R approach  is necessary for the remainder of the renamed functions.

Beautiful, thanks!


Add downloaded bosh lite stemcell to gitignore

The process of installing a bosh-lite + cf requires a bosh-lite stemcell to be downloaded. At the end of the process, my local git repository reported some changes:
± dlr |master ?:1 ✗| → git status
On branch master
Your branch is up-to-date with 'origin/master'.
Untracked files:
  (use "git add <file>..." to include in what will be committed)

        latest-bosh-lite-stemcell-warden.tgz

nothing added to commit but untracked files present (use "git add" to track)

This PR adds the downloaded latest-bosh-lite-stemcell-warden.tgz to gitignore.

Hey,
I did publicize my membership of pivotal-cf org.
As per my understanding, that should be enough.

Thanks for the PR - can you clarify how you got a file named latest-bosh*-stemcell-warden.*? Nowadays, bosh.io should be giving names in a very predictable format of bosh-stemcell-*-warden-boshlite-ubuntu-trusty-go_agent.tgz, so I don't think the .gitignore should need to change. Hoping you can point us to a doc that we can update instead.

Actually I'm using the bin/provision_cf script. That script is downloading the lite stemcell locally with a name which currently is not compatible with with the name in the gitignore.
Updating the gitignore seems to be the change with less impact to sort it out.

Fair enough - thanks for the links.
For what it's worth, we're trying to encourage people to start using bosh-deployment, and, specifically, the bosh-lite ops file there. If you get a chance, you might want to try that out.


Rename scheme with schema

@dbalseiro Suggest that we should rename the word scheme with schema which would be a better name.

scheme:
a large-scale systematic plan or arrangement for attaining some particular object or putting a particular idea into effect.
schema:
a representation of a plan or theory in the form of an outline or model.

@juanpaucar Thanks for the references. I think the .schema.yml is an outline for the type checking.

 Rename scheme with schema


Error: AutoForm: No component found for rendering input with type "fileUpload"

I'm getting on load:
Exception in template helper: Error: AutoForm: No component found for rendering input with type "fileUpload"
at Object.afFieldInputContext (http://localhost:3000/packages/aldeed_autoform.js?2588d9685540ec52256cb14d51c3586e9727dbe1:6983:13)
at http://localhost:3000/packages/blaze.js?4e49999979a58da0e2265f7bd3f5910f9901b07b:2786:16
at http://localhost:3000/packages/blaze.js?4e49999979a58da0e2265f7bd3f5910f9901b07b:1607:16
at http://localhost:3000/packages/blaze.js?4e49999979a58da0e2265f7bd3f5910f9901b07b:2834:66
at Function.Template._withTemplateInstanceFunc (http://localhost:3000/packages/blaze.js?4e49999979a58da0e2265f7bd3f5910f9901b07b:3382:12)
at http://localhost:3000/packages/blaze.js?4e49999979a58da0e2265f7bd3f5910f9901b07b:2833:27
at Object.Spacebars.call (http://localhost:3000/packages/spacebars.js?7bafbe05ec09b6bbb6a3b276537e4995ab298a2f:172:18)
at http://localhost:3000/packages/aldeed_autoform.js?2588d9685540ec52256cb14d51c3586e9727dbe1:6902:23
at wrappedArgFunc (http://localhost:3000/packages/blaze.js?4e49999979a58da0e2265f7bd3f5910f9901b07b:2701:14)
at null. (http://localhost:3000/packages/blaze.js?4e49999979a58da0e2265f7bd3f5910f9901b07b:2507:26
I get the same with AutoForm 5 and 4.2.2. I tested the regular aldeed autoform filepicker under the same conditions and it works.  I created a test project just for this and copied the instructions verbatim.  Thanks for any help.

Same error

Same problem.
Is it normal if I stay on the 0.0.2 version of the package ?
When I try to update the package I have this message: "Your packages are at their latest compatible versions."
Surely a compatibility issue with another package, but which one ?...

Exception in template helper: Error: AutoForm: No component found for rendering input with type "fileUpload"

Having the same issue....

+1

I have the same issue with the latest version


withParentHeader should not be visible?

Request overrides the withHeader method declared in MessageTrait, so the original one is aliased to withParentHeader.
Shouldn't it be protected or private?

Ah yes, that would be ideal.


All options in type declaration are marked as required which doesn't appear to line up with the code itself

The types provided for the options object say that all items are required, yet the documentation and source code suggest that not all the options are required.
https://github.com/atomiks/rehype-pretty-code/blob/445a50ef8633594a5c9af792b77041f6b058695b/index.d.ts#L5-L15

I'm not sure what the common convention is here, but an Options object lists all the properties which can be passed, but functions that accept it would themselves specify Partial<Options>.

So, the case I particularly had was defining an object literal and wanting to use the satisfies keyword to check it against the valid options. But if I omit the required fields (all of them in this case) TS complains at me. However, if I use Partial, then it won't complain at all even if I don't include any options. Which I guess is fine if it provides fallbacks for all the options when not specified.

yes, I guess satisfies Partial<Options> is fine


[Question]: Table relationship problem

Question Validation

[X] I have searched both the documentation and discord for an answer.

Question
Hello,
I have 2 simple tables:
bookings = Table(
"bookings",
metadata_obj,
Column("number", Integer, primary_key=True),
Column("date", Date, nullable=False),
Column("state_id", Integer, ForeignKey("states.state_id"), nullable=False),
)
states = Table(
"states",
metadata_obj,
Column("state_id", Integer, primary_key=True),
Column("state", String(16), nullable=False),
)
In the states table I only have 2 states:
1 - finished
2- canceled
When I ask the question "Total of canceled bookings?" it returns the query "SELECT COUNT(*) FROM bookings WHERE state_id = 3", where did it find state_id = 3??

@acamenhas it probably hallucinated it, this can happen, especially for open source LLMs


Automatic (precaned) grafana dashboards from drawio

Starting from a clab file, it would be coo. to have a tool (can be another python script) that generates the JSON  grafana dashboard displaying  some pre-caned things like the link speed on each of the ports.
Some things to take into account:

the metrics format is determined by the collector (e.g, gnmic and processors), so the key values need to be probably used as  input parameters.
The metrics tags can also be changed in grafana and they need to be consistent for the flowcharts plugin to work
Goal is not to have a do it all tool, but rather a simple dashboard that can be further expanded and customized for every lab...

A WIP on this fork:
clab2grafana


Statistics monitoring

The aim of this pull request is to add statistics that can be monitored through prometheus as time-series metrics.

Please rebase @Skantes


Extension causes high cpu load

Issue Type: Performance
Extension Name: csharp
Extension Version: 1.17.1
OS Version: Darwin x64 18.2.0
VSCode version: 1.30.2

:warning: Make sure to attach this file from your home-directory: /Users/afrahalshahrani/ms-vscode.csharp-unresponsive.cpuprofile.txt :warning:
Find more details here: https://github.com/Microsoft/vscode/wiki/Explain:-extension-causes-high-cpu-load

@afrahshahrani Can you try with the latest version of the extension(1.18.0) and check if the problem still persists ?

Closing due to lack of response.


getting error when trying to read logs

PS C:\projects\Minimart\Minimart> heroku logs
!    Heroku client internal error.
!    Search for help at: https://help.heroku.com
!    Or report a bug at: https://github.com/heroku/heroku/issues/new
Error:       uninitialized constant Heroku::Command::RestClient (NameError)
Command:     heroku logs
Version:     heroku/toolbelt/3.37.1 (i386-mingw32) ruby/1.9.3
Error ID:    abc6c505ff57467f81da2683fb2819e9

More information in C:/Users/User/.heroku/error.log

might have to reinstall the toolbelt

@ZeusIV, this issue may have become stale. Are you still experiencing this problem? Have you tried with the newest toolbelt release?
Thanks for any info you can provide. (And, if this problem has been resolved let's see about getting it closed.)


Multipath disapears after resize

After resizing using control points, multipath won't appear anymore.
Steps to Reproduce:
1 - Open "Wirez Resize" example under "Wires Examples" section in Lienzo Kitchen
2 - Shift+Left Click on the shape
3 - Move top right point over top left point. (They have to be positioned on top of each other).
4 - Move any of the other control points.
Video: https://youtu.be/1btBZoAFJzM

Hello! I made a fix for this one. Let me now if there's something that I could improve or if it can break anything that I'm not familiar with yet. Thank you.
P.S.: I'm not sure about the coding standards you guys are following, so I've followed the coding of the classes that I changed.

I want to do more but my IntelliJ license it's about to expire in 2 days. Do you guys have some step-by-step that I can read to learn how to debug Lienzo in Eclipse? Thank you!

Might this help?
https://stackoverflow.com/questions/18330001/super-dev-mode-in-gwt

Thanks! I did it. :)
It was easier than I thought. I was just missing one setting in Eclipse. Now it's working with break points too.


Add Double Life by Pharrell Williams

Song Name
Double Life
Artist Name
Pharrell Williams
Source
Youtube
Youtube Link
fWtn6RMNiok
Direct File Link
No response
Song ID
76743
Start Offset [ms]
0
Extra
Created from Auto Nong.
Created for level: 110662000
Downloaded: No

STILL STANDING


Switch from GCC 4.6 to 4.7 results in fprintf timing glitches

We've been tracking this issue for a while here and finally collected enough evidence:
Switching from GCC 4.6 to GCC 4.7, fprintf starts causing timing glitches. See comparison DT plot below (same code, same hardware) (Thanks to @mazahner for the plot/data)

These glitches "leak" into other file-writing threads, even if they don't use fprintf. However, non-fprintf file writing works fine on its own.
To complicate things, while going back to 4.6 could help (and a good way to troubleshoot), some code has been introduced that doesn't compile in 4.6. See e.g. class-decl initializers in gps_helper.h. Toolchain flexibility remains important in light of these issues and it might be a good idea to stick to 4.6 compatibility.
Has anyone experienced similar fprintf issues and does anyone have any pointers to resolving this?
Thanks in advance.
-sergei

@davids5 This could be related again to the busy handling of the card.

Now after fixing the SPI code, re-testing this would be nice. I suspect you get fine results now on master.


HDHomeRun linux EPG data missing from channels

With the native linux HDHomeRun support, channels get scanned and you can tune in, however the EPG data is not received like on the SageTV 7 setup on Windows.
First you would need to understand how the EPG stream of a channel is received in SageTV, most likely something is not setup correctly for HDHomeRun.

Are you referring to pulling the EPG data from the ATSC/DVB stream itself? Or are you talking about setting up EPG data reception from the SageTV EPG server?

I'm referring to pull the EPG data directly from the ATSC/DVB stream. As I was away a month I checked with the latest code (build number 208) but no change, still no EPG data. On my Windows 7.x installation it works.


Adapter blockiert Pocket WiFi 3

Describe the bug :
Ausgangslage:
Adapter: v0.6.0
Pocket Wifi 3 Firmware Version: 3.001.02
Betriebsart: Local IP Wifi Pocket Stick
Der Adapter arbeitet einwandfrei und liefert die Daten  während ca. 5 bis 10 Minuten.
Danach blockiert der Adapter die Kommunikation mit dem Pocket Wifi d.h. das Pocket Wifi kann mit der lokalen IP-Adresse via Browser nicht mehr angesprochen werden - es gibt keine Rückmeldung via Browser.
Sobald der Adapter gestoppt wird, kann das Pocket Wifi via Browser wieder korrekt angesprochen werden.
Die Abfrage mittels curl funktioniert ohne Probleme.

Habe Standardeinstellung 10s verwendet.
Versuche jetzt mit 60s und melde mich später zurück.

Auch mit 60s Invervall "blockiert" der Adapter den Pocket Wifi nach ca. 80 min.
Nach dem Stoppen des Adapters kann wieder mit dem Pocket WiFi kommuniziert werden.

Stelle den Adapter auf debuglog und beobachte mal im Log, was passiert.
bitte hier dann den Log posten

N.B.: Vom host. werden auch falsche Timestamps ins log geschrieben (Zeitverschiebung von +7h nicht berücksichtigt, obwohl die Zeit in ioBroker richtig angezeigt wird).

Ich habe via Node-Red einen periodischen curl Abruf gestartet (30s Interval).

Ich baue am WE mal ein paar Debugs ein.

Ich hab das gleiche Problem, nur dass mein Pocket Wifi nicht nach 5-10 Minuten abschmiert, sondern erst nach ~24h. Ich habe 10s Abfrageintervalle eingestellt. Ein Neustart des iobroker Adapters hilft sofort.
Wenn ich irgendwas dazu beitragen kann, dass das nicht mehr passiert, dann gerne.

Du kannst 10 Sekunden weiter belassen

Wichtig ist, in der Config von Solax muss die richtige Firmware-Version des Sticks gewählt sein.

Danke - ich werde den Test asap starten

Test gestartet 10:00
Interval 10 sec.
Seit  2023-04-28 19:27 kommen keine Daten mehr
ist schon bedeutend besser!

Der Pocket Wifi bleibt auch nicht mehr blockiert - sehr gut.
Ich glaube es gibt auch ein Problem bei der Berechnung der Astrodaten (Nacht).
Einmal besten Dank für den Effort. Hoffentlich kann der Fehler auch lokalisiert werden so dass der Adapter stabil wird.
Kann ich mit weiteren Infos helfen?

Korrektur: Die Astro Daten kommen weiterhin regelmässig - es werden nur keine Inverterdaten mehr geliefert.

Verstehe deine Antwort nicht. Welche Version? Was für Daten kommen nicht?
Debuglog?

Ineressant: Nachdem "is Night: true" werden keine Daten vom Inverter mehr aktualisiert, dh. wärend der "Nacht"  kommen keine  "local request: {"sn":"xxxx","ver":"3.006.04","type":14,"Data":[0,0,0,0,0,0,0,0,0,0,3640,3701,42,41, ..... " mehr.

Das ist soweit mal gut, dass der Adapter bisher (1 Tag) stabil läuft!
Die Inverter Daten sollten jedoch auch während der Nacht aktualisiert werden (nicht nur während dem Tag).
Die Berechnung von
07:57:30.224 | debug | is Night: false
stimmt nicht für meine Location (gesetzt in den ioBroker Einstellungen)
Richtig wäre:
Sunrise: 29.04.2023 06:00:58
Sunset: 29.04.2023 18:34:02
Hilft das weiter oder benötigst Du Debuglog?

Getestet mit Version v0.7.2

Du kannst doch im Config Menü selber bestimmen, ob Nachts Daten kommen sollen oder nicht

Vielen Dank für den Hinweis, diese Einstellung habe ich vollkommen übersehen!
Entschuldige bitte meine "Fehlermeldung".
Der Adapter läuft bisher stabil.

Ich finde kein Objekt z.B. "isNight". Es wäre sicher nützlich, dieses ebenfalls unter den Astro-Daten zu finden.
Vielen Dank!

Bist Du interessiert den Adapter zu verbessern?

Wenn Du interessiert bist, kann ich Dir gern noch weiter Decodierungen nennen.
Besten Dank!

Bitte teste v0.7.3

Bitte diesen issue wieder öffnen - es gibt noch Fehler (siehe oben)


fatal error: unexpected signal during runtime execution

Describe the bug
gtk.ImageNewFromFile (and gtk.ImageNewFromPixbuf()) gives a fatal error. I have tried several different jpg:s and png:s.
To Reproduce
package main

import (
	"fmt"
	"github.com/gotk3/gotk3/gdk"
	"github.com/gotk3/gotk3/gtk"
)

func main() {
	imagePath := "/home/per/temp/Best.png"
	image, err := gtk.ImageNewFromFile(imagePath)
	if err!=nil {
		panic(err)
	}
	fmt.Println(image.GetAllocation())
}

Expected behavior
No error message
Error messages
GOROOT=/usr/lib/go #gosetup
GOPATH=/home/per/go #gosetup
/usr/lib/go/bin/go build -o /home/per/code/test/test -gcflags all=-N -l . #gosetup
/var/lib/snapd/snap/goland/106/plugins/go/lib/dlv/linux/dlv --listen=<IP_ADDRESS>:41703 --headless=true --api-version=2 --check-go-version=false --only-same-user=false exec /home/per/code/test/test --
API server listening at: [::]:41703
(process:90209): Gtk-CRITICAL **: 18:57:50.140: _gtk_style_provider_private_get_settings: assertion 'GTK_IS_STYLE_PROVIDER_PRIVATE (provider)' failed
(process:90209): Gtk-CRITICAL **: 18:57:50.142: _gtk_style_provider_private_get_settings: assertion 'GTK_IS_STYLE_PROVIDER_PRIVATE (provider)' failed
(process:90209): Gtk-CRITICAL **: 18:57:50.142: _gtk_style_provider_private_get_settings: assertion 'GTK_IS_STYLE_PROVIDER_PRIVATE (provider)' failed
fatal error: unexpected signal during runtime execution
[signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x7fdbd1350c1c]
runtime stack:
runtime.throw(0x6cb5b9, 0x2a)
/usr/lib/go/src/runtime/panic.go:1116 +0x72
runtime.sigpanic()
/usr/lib/go/src/runtime/signal_unix.go:704 +0x269
goroutine 1 [syscall]:
runtime.cgocall(0x5b6ad0, 0xc00010ddf8, 0x1f99920)
/usr/lib/go/src/runtime/cgocall.go:133 +0x5b fp=0xc00010ddc8 sp=0xc00010dd90 pc=0x47e03b
github.com/gotk3/gotk3/gtk._Cfunc_gtk_image_new_from_pixbuf(0x1f99920, 0x0)
_cgo_gotypes.go:14924 +0x4a fp=0xc00010ddf8 sp=0xc00010ddc8 pc=0x55908a
github.com/gotk3/gotk3/gtk.ImageNewFromPixbuf.func1(0xc000010038, 0x0)
/home/per/go/pkg/mod/github.com/gotk3/gotk3@v0.5.1-0.20201028052159-952547abf55a/gtk/gtk.go:5281 +0x73 fp=0xc00010de40 sp=0xc00010ddf8 pc=0x577133
github.com/gotk3/gotk3/gtk.ImageNewFromPixbuf(0xc000010038, 0x0, 0x0, 0x0)
/home/per/go/pkg/mod/github.com/gotk3/gotk3@v0.5.1-0.20201028052159-952547abf55a/gtk/gtk.go:5281 +0x45 fp=0xc00010de88 sp=0xc00010de40 pc=0x569d45
main.main()
/home/per/code/test/main.go:15 +0x135 fp=0xc00010df88 sp=0xc00010de88 pc=0x585d35
runtime.main()
/usr/lib/go/src/runtime/proc.go:204 +0x1cf fp=0xc00010dfe0 sp=0xc00010df88 pc=0x4b790f
runtime.goexit()
/usr/lib/go/src/runtime/asm_amd64.s:1374 +0x1 fp=0xc00010dfe8 sp=0xc00010dfe0 pc=0x4e9fe1
Debugger finished with exit code 0
Environment:
gtk3 version: 3.24.23-4
go version: 1.15.3
os: Manjaro (Cinnamon)
Additional information
Because of #670, I am currently running on the master branch instead of 0.5.0. Maybe this is my problem? Maybe I should not run on go 1.15.3, and then use the 0.5.0 (or older) release instead?
go.mod:
module test

go 1.15

require (
	github.com/gotk3/gotk3 v0.5.1-0.20201028052159-952547abf55a
)

I can't reproduce on Ubuntu focal ... sorry, that work for me.
i got &{{{-1 -1 1 1}}} from GetAllocation without error.
maybe someone on Manjaro could help you.

Thanks, then I know that something is wrong on my machine. I am experimenting with using multiple Go versions now, so that I can use 1.14.x instead of 1.15.x that is on Manjaro right now, but I have not gotten it to work yet. Hopefully that will solve my problem.

Now when I have changed to Go 1.14 and GoTK 0.4.0, I get a shorter error message, this is the ouput. To me, it looks like it is compiling against 1.14, and the mod file specifies to use GoTK 0.4.0, correct? So then I guess it must be a problem that is related to my machine or Manjaro, right?:
GOROOT=/home/per/go1.14.11 #gosetup
GOPATH=/home/per/go #gosetup
/home/per/go1.14.11/bin/go build -o /tmp/___test2 -gcflags all=-N -l . #gosetup
/var/lib/snapd/snap/goland/106/plugins/go/lib/dlv/linux/dlv --listen=<IP_ADDRESS>:33735 --headless=true --api-version=2 --check-go-version=false --only-same-user=false exec /tmp/___test2 --
API server listening at: [::]:33735

(process:165363): Gtk-CRITICAL **: 08:11:03.655: _gtk_style_provider_private_get_settings: assertion 'GTK_IS_STYLE_PROVIDER_PRIVATE (provider)' failed

(process:165363): Gtk-CRITICAL **: 08:11:03.656: _gtk_style_provider_private_get_settings: assertion 'GTK_IS_STYLE_PROVIDER_PRIVATE (provider)' failed

(process:165363): Gtk-CRITICAL **: 08:11:03.656: _gtk_style_provider_private_get_settings: assertion 'GTK_IS_STYLE_PROVIDER_PRIVATE (provider)' failed
fatal error: unexpected signal during runtime execution

Debugger finished with exit code 0

My go.mod file :
module github.com/hultan/test2

go 1.14

require github.com/gotk3/gotk3 v0.4.0

Have you tested in pure C to determine if issue come from gotk3 or not ?
So, i give you a piece of code in Go but using C, gotk3 is not used with it. This way, you will be able to know from where issue come.
Explanations:
  GtkWidget *image=gtk_image_new_from_file (filename);			Load image from file
  GdkPixbuf *pixbuf=gtk_image_get_pixbuf (GTK_IMAGE(image));		Convert loaded image to pixbuf
  GtkWidget *image_pbuf=gtk_image_new_from_pixbuf (pixbuf);		Create image from pixbuf
  GdkPixbuf *pixbuf_img=gtk_image_get_pixbuf (GTK_IMAGE(image));	Convert created image to pixbuf

This covers your entire problem. gtk.ImageNewFromFile (and gtk.ImageNewFromPixbuf()) gives a fatal error.
package main

/*

#cgo pkg-config: gdk-3.0 gobject-2.0 gtk+-3.0
#include <gtk/gtk.h>

gboolean draw_picture(GtkWidget *da, cairo_t *cr, gpointer data)
{
  gint width=gtk_widget_get_allocated_width(da);
  gint height=gtk_widget_get_allocated_height(da);

  GdkPixbuf *temp=gdk_pixbuf_scale_simple((GdkPixbuf*)data, width, height, GDK_INTERP_BILINEAR);
  gdk_cairo_set_source_pixbuf(cr, temp, 0, 0);
  cairo_paint(cr);

  g_object_unref(temp);
  return FALSE;
}

int launch(const char *filename)
{
  gtk_init(NULL, NULL);

  GtkWidget *window=gtk_window_new(GTK_WINDOW_TOPLEVEL);
  gtk_window_set_title(GTK_WINDOW(window), "gdk_pixbuf_new_from_file");
  gtk_window_set_position(GTK_WINDOW(window), GTK_WIN_POS_CENTER);
  gtk_window_set_default_size(GTK_WINDOW(window), 400, 400);

  g_signal_connect(window, "destroy", G_CALLBACK(gtk_main_quit), NULL);

  //Needs a valid picture.
  GtkWidget *image=gtk_image_new_from_file (filename);
  GdkPixbuf *pixbuf=gtk_image_get_pixbuf (GTK_IMAGE(image));
  GtkWidget *image_pbuf=gtk_image_new_from_pixbuf (pixbuf);
  GdkPixbuf *pixbuf_img=gtk_image_get_pixbuf (GTK_IMAGE(image));

  GtkWidget *da1=gtk_drawing_area_new();
  gtk_widget_set_hexpand(da1, TRUE);
  gtk_widget_set_vexpand(da1, TRUE);
  g_signal_connect(da1, "draw", G_CALLBACK(draw_picture), pixbuf_img);

  GtkWidget *grid=gtk_grid_new();
  gtk_grid_attach(GTK_GRID(grid), da1, 0, 0, 1, 1);

  gtk_container_add(GTK_CONTAINER(window), grid);
  gtk_widget_show_all(window);

  gtk_main();

  g_object_unref(image);
  g_object_unref(pixbuf);
  g_object_unref(image_pbuf);
  g_object_unref(pixbuf_img);

  return 0;
}

*/
import "C"
import (
	"fmt"
	"unsafe"
)

func main() {
	cstr := C.CString("Library-48.png")
	defer C.free(unsafe.Pointer(cstr))
	C.launch(cstr)
}

Note: change "Library-48.png" with an image placed in the directory where you store this code.

I unfortunately don't know how to compile c code. I tried to copy the code above into a file I called image.c, and then ran gcc image.c but that gives me errors. So I guess I am doing something wrong, or are missing some libraries or something.
Why is most of the code above commented out?
>gcc image.c
image.c:1:1: error: unknown type name ‘package’
    1 | package main
      | ^~~~~~~
image.c:60:1: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘import’
   60 | import "C"
      | ^~~~~~

It's a Go file, name it using "main.go"
go build main.go

Ah, now it compiles. I had to remove imports "fmt" though...No errors, and it opens a window. So what does that mean?
A lot of gtk errors though...
>./image

(image:181258): GdkPixbuf-CRITICAL **: 11:34:41.666: gdk_pixbuf_scale_simple: assertion 'GDK_IS_PIXBUF (src)' failed

(image:181258): GdkPixbuf-CRITICAL **: 11:34:41.666: gdk_pixbuf_get_n_channels: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:181258): GdkPixbuf-CRITICAL **: 11:34:41.666: gdk_pixbuf_get_height: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:181258): GdkPixbuf-CRITICAL **: 11:34:41.666: gdk_pixbuf_get_width: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:181258): GLib-GObject-CRITICAL **: 11:34:41.667: g_object_unref: assertion 'G_IS_OBJECT (object)' failed

(image:181258): Gtk-WARNING **: 11:34:41.667: drawing failure for widget 'GtkDrawingArea': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:181258): Gtk-WARNING **: 11:34:41.667: drawing failure for widget 'GtkGrid': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:181258): Gtk-WARNING **: 11:34:41.667: drawing failure for widget 'GtkWindow': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:181258): GdkPixbuf-CRITICAL **: 11:34:41.783: gdk_pixbuf_scale_simple: assertion 'GDK_IS_PIXBUF (src)' failed

(image:181258): GdkPixbuf-CRITICAL **: 11:34:41.783: gdk_pixbuf_get_n_channels: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:181258): GdkPixbuf-CRITICAL **: 11:34:41.783: gdk_pixbuf_get_height: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:181258): GdkPixbuf-CRITICAL **: 11:34:41.783: gdk_pixbuf_get_width: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:181258): GLib-GObject-CRITICAL **: 11:34:41.783: g_object_unref: assertion 'G_IS_OBJECT (object)' failed

(image:181258): Gtk-WARNING **: 11:34:41.783: drawing failure for widget 'GtkDrawingArea': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:181258): Gtk-WARNING **: 11:34:41.783: drawing failure for widget 'GtkGrid': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:181258): Gtk-WARNING **: 11:34:41.783: drawing failure for widget 'GtkWindow': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:181258): Gtk-WARNING **: 11:34:47.461: A floating object was finalized. This means that someone
called g_object_unref() on an object that had only a floating
reference; the initial floating reference is not owned by anyone
and must be removed with g_object_ref_sink().

(image:181258): GLib-GObject-CRITICAL **: 11:34:47.462: g_object_unref: assertion 'G_IS_OBJECT (object)' failed

(image:181258): Gtk-WARNING **: 11:34:47.462: A floating object was finalized. This means that someone
called g_object_unref() on an object that had only a floating
reference; the initial floating reference is not owned by anyone
and must be removed with g_object_ref_sink().

(image:181258): GLib-GObject-CRITICAL **: 11:34:47.462: g_object_unref: assertion 'G_IS_OBJECT (object)' failed

I've edited message before, maybe you have the 1st version ...
try to copy paste again

I tried the new code, but the same result basically. How do we interpret this result though. Does it mean that the problem is on my machine?
./image

(image:183201): GdkPixbuf-CRITICAL **: 11:42:13.622: gdk_pixbuf_scale_simple: assertion 'GDK_IS_PIXBUF (src)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:13.622: gdk_pixbuf_get_n_channels: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:13.622: gdk_pixbuf_get_height: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:13.622: gdk_pixbuf_get_width: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GLib-GObject-CRITICAL **: 11:42:13.622: g_object_unref: assertion 'G_IS_OBJECT (object)' failed

(image:183201): Gtk-WARNING **: 11:42:13.622: drawing failure for widget 'GtkDrawingArea': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): Gtk-WARNING **: 11:42:13.622: drawing failure for widget 'GtkGrid': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): Gtk-WARNING **: 11:42:13.622: drawing failure for widget 'GtkWindow': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): GdkPixbuf-CRITICAL **: 11:42:13.739: gdk_pixbuf_scale_simple: assertion 'GDK_IS_PIXBUF (src)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:13.739: gdk_pixbuf_get_n_channels: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:13.739: gdk_pixbuf_get_height: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:13.739: gdk_pixbuf_get_width: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GLib-GObject-CRITICAL **: 11:42:13.739: g_object_unref: assertion 'G_IS_OBJECT (object)' failed

(image:183201): Gtk-WARNING **: 11:42:13.739: drawing failure for widget 'GtkDrawingArea': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): Gtk-WARNING **: 11:42:13.739: drawing failure for widget 'GtkGrid': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): Gtk-WARNING **: 11:42:13.739: drawing failure for widget 'GtkWindow': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): GdkPixbuf-CRITICAL **: 11:42:22.711: gdk_pixbuf_scale_simple: assertion 'GDK_IS_PIXBUF (src)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:22.711: gdk_pixbuf_get_n_channels: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:22.711: gdk_pixbuf_get_height: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:22.711: gdk_pixbuf_get_width: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GLib-GObject-CRITICAL **: 11:42:22.711: g_object_unref: assertion 'G_IS_OBJECT (object)' failed

(image:183201): Gtk-WARNING **: 11:42:22.711: drawing failure for widget 'GtkDrawingArea': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): Gtk-WARNING **: 11:42:22.711: drawing failure for widget 'GtkGrid': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): Gtk-WARNING **: 11:42:22.711: drawing failure for widget 'GtkWindow': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): GdkPixbuf-CRITICAL **: 11:42:25.494: gdk_pixbuf_scale_simple: assertion 'GDK_IS_PIXBUF (src)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:25.494: gdk_pixbuf_get_n_channels: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:25.494: gdk_pixbuf_get_height: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GdkPixbuf-CRITICAL **: 11:42:25.494: gdk_pixbuf_get_width: assertion 'GDK_IS_PIXBUF (pixbuf)' failed

(image:183201): GLib-GObject-CRITICAL **: 11:42:25.494: g_object_unref: assertion 'G_IS_OBJECT (object)' failed

(image:183201): Gtk-WARNING **: 11:42:25.494: drawing failure for widget 'GtkDrawingArea': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): Gtk-WARNING **: 11:42:25.494: drawing failure for widget 'GtkGrid': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): Gtk-WARNING **: 11:42:25.494: drawing failure for widget 'GtkWindow': invalid value (typically too big) for the size of the input (surface, pattern, etc.)

(image:183201): GLib-GObject-CRITICAL **: 11:42:37.020: g_object_unref: assertion 'G_IS_OBJECT (object)' failed

No I screwed up, now it works, I get an image. Forgot to change the image path after i copied the code again...

lol
man
have you put YOUR image in the directory that hold your code ?

See above, I forgot to change the image path after I copied the code. It works now...
How to interpret that though, is the problem my machine (ignore my incompetence for a while :-) )?

It's ok ^^ don't worry
So, look like your os is ok, cgo too, then i really don't know ...
this look like out of my competencies, the difference between you and me is Ubuntu/Manjaro ...
I think I can't help you anymore, hope someone can.
below my actual configuration:

Name
Version / Info / Name

GOLANG
V1.15.4 -> GO111MODULE="off", GOPROXY="direct"

DISTRIB
LinuxMint Xfce

VERSION
20

CODENAME
ulyana

RELEASE
#46-Ubuntu SMP Fri Jul 10 00:24:02 UTC 2020

UBUNTU_CODENAME
focal

KERNEL
5.8.0-25-generic

HDWPLATFORM
x86_64

GTK+ 3
3.24.20

GLIB 2
2.64.3

CAIRO
1.16.0

GtkSourceView
4.6.0

LiteIDE
37.3 qt5.x

Qt5
5.12.8 in /usr/lib/x86_64-linux-gnu

Ok, thanks for your help. It is not a super important project anyway, so I'll just wait and pick it up later, hoping that the problem will magically solve itself somehow :-)

@hfmrow :
@moson from the Manjaro forum pointed out that I had forgot the gtk.Init(nil)! That was the answer, so sorry for wasting your time with such a newbie mistake :-(

ahh yes, I should have seen it, indeed, when I tested the code, I integrated it into my test matrix which already contains the windows initialization elements, I did not pay attention to it .. .


Offline Custom Data + Offline Geocoding

The documentation, explains how to load offline data, however, the offline geocoder and reverse geocoder's documentation states that the data is preprocessed, by CartoDB - via Pelias from what I understood. However, and since .mbtiles do - can - contain all the PoI and street information, which they often do, is CartoDB's offline geocoder not able to process said format by default? Is the Pelias format required? This would result in duplicate data, as the map render cannot simply not contain street names and so forth, vectors without street names and so on, aren't of much use to the user.
Sorry if this seems rather rude, just trying to figure this whole thing out!

@lhorus We have now published the scripted needed for creating offline map, routing and geocode packages: https://github.com/nutiteq/mobile-sdk-scripts.
Closing this.


Searchbroker api calls

set site name when registering at the searchbroker
delete searchbroker registration in the searchbroker database
feature property to activate or deactivate "set site name" feature
changed share-common version to 4.1.0

TODO for next sprint: Change old version of searchborker


Upload PGE Token

Dear consenlabs, please accept my pull request for add PGE token profile to imtoken. Thanks you.
"PGE": "Plutaneum Gaming Exchange"
Contract address: "0xbdF2e5D2DaCD341c2aaD8E73c83495FaBFFf3E5f",

hi consenlabs, wanna know how long it takes to merge the code? thanks

Thank you!


Dark mode should be a good enhancement

If this website will have dark mode then it would look even better.

Thanks for the suggestion, sounds like a great idea


tf.contrib.data.Dataset fails to batch elements that are tuples

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): yes
OS Platform and Distribution: Linux Ubuntu 16.04.2 LTS
TensorFlow installed from (source or binary): source
TensorFlow version (use command below): ('v1.2.0-rc0-312-g0b72359', '1.2.0-rc0')
Bazel version (if compiling from source): 0.4.5
CUDA/cuDNN version: 8.0
GPU model and memory: TITAN X (Pascal) / 12186MiB

Issue
With the new tf.contrib.data.Dataset API, it seems not possible to batch the outputs of a Dataset instance whose elements are tuples.  Code demonstrating problem:
ds = tf.contrib.data.Dataset.range(100).map(lambda x: (x, 2*x))
batched_ds = ds.batch(4)
batched_iter = batched_ds.make_one_shot_iterator()
nxt = batched_iter.get_next()

with tf.Session() as sess:
    val = sess.run(nxt)
    print(type(val))  # => <type 'tuple'>
    print(len(val))  # => 2

It seems that sess.run(nxt) should provide an object having 4 elements.

val is a tuple of batches, in this case, print(val) yields:
(array([0, 1, 2, 3]), array([0, 2, 4, 6]))

@mrry for comments on how batch is intended to and documented to deal with tuples.

On second thought, I think this is the expected behavior -- seemed unintuitive though because the batching is done by grouping elements of a series of tuples, rather than grouping the series of tuples where each tuple is a row in the output 'batch tensor'.


[SchemaRegistry] use federated auth

Added Federated Auth to tests.yml
Removed Client Secret/Client ID/Tenant ID in test-resources.json

/azp run python - schemaregistry - tests


Harvested resources are not usable for processing

Resources manually harvested from creatures or plants will have a physical type assigned (root, seed, leaf, etc. for plant resources). These resources appear to not be eligible for further processing in outposts. This is most easily observed with Animal Husbandry Facilities. These will typically require an input of Water and Fiber (at least every one I've seen requires fiber). This will work normally if the resource is supplied by another outpost building such as a Greenhouse or if the player purchases generic Fiber to use. However, if one for example places harvested Fiber (Tissue) in a connected container, processing will not occur, despite the husbandry facility claiming that it has sufficient resources available.
Using the harvested resource in regular crafting via an outpost workbench works fine.

Details
Fiber: 55AF
Fiber (Tissue): 24F5C3
Game Version
<IP_ADDRESS>
New Game
No
Reproduction Steps

Place an outpost on a planet with harvestable creatures
Construct an Animal Husbandry Facility, a water supply, and a solid storage container for fiber input
Place manually harvested fiber in the connected container

Accidentally closed.  Reopening


[BUG] groupRequestParticipantsList not working

Describe the bug
groupRequestParticipantsList always returns an empty array. I logged the groupQuery response in Baileys and content is undefined.
{
  result: {
    tag: 'iq',
    attrs: {
      from<EMAIL_ADDRESS>      type: 'result',
      id: '123.123-2'
    },
    content: [
      {
        tag: 'membership_approval_requests',
        attrs: {},
        content: undefined
      }
    ]
  }
}

It seems weird that it even queries membership_approval_requests.. Does that actually return a group members list? Or am I misunderstanding the purpose of the function?
Environment (please complete the following information):

Is this on a server? no
What do your connectOptions look like? default
Do you have multiple clients on the same IP? no
Are you using a proxy? no

Oh nvm, I thought that was for listing group participants...


Variables not declared, only identified if you specify an image size …

…in 'px'
Resolves #14260

Thank you. But unfortunately we already landed the first fix for this issue. See #13976


how to set line space

how to set line space
help me.

insertHtml("");

I resolved loading a css file on the WebView.
To do it, you need to create a directory called "assets", insert your css file here and load your css file with "editor.loadCSS("name.css")"


createIndexDecorator has problems with "underscored" or "field" params

Versions

sequelize: 5.21.3
sequelize-typescript: 1.1.0
typescript 3.7.4

I'm submitting a ...
[x] bug report
[ ] feature request
Actual behavior:
I've tried using new feature - createIndexDecorator, but it doesn't take into account the underscored table param (field param on the column doesn't work either) - therefor it errors out on database level, because there are no such fields existing.
Expected behavior:
Successful creation of index.
Steps to reproduce:
Code is below.
Related code:
const OwnedItemUniqueIndex = createIndexDecorator({type: "UNIQUE"});

@Table({
  tableName: "game_owned_items",
  underscored: true
})
export default class OwnedItem extends Model<OwnedItem> {
  @PrimaryKey
  @AutoIncrement
  @Column
  public id: number;

  @OwnedItemUniqueIndex
  @Column
  public ownerId: number;

  @OwnedItemUniqueIndex
  @Column
  public itemId: number;
}

"Temporary fix"
const OwnedItemUniqueIndex = createIndexDecorator({ type: "UNIQUE" });

@Table({
  tableName: "game_owned_items",
  underscored: true
})
export default class OwnedItem extends Model<OwnedItem> {
  @PrimaryKey
  @AutoIncrement
  @Column
  public id: number;

  // @ts-ignore
  @OwnedItemUniqueIndex({ name: "owner_id"})
  @ForeignKey(() => Soldier)
  @Column
  public ownerId: number;

  // @ts-ignore
  @OwnedItemUniqueIndex(({ name: "item_id" }))
  @ForeignKey(() => Item)
  @Column
  public itemId: number;
}

Works with PostgreSQL.

Hey @piotrmoszkowicz, thanks for reporting.

I have a similar problem where:

I also have this issue, and as jessemyers have pointed out, the problem is directly related to the @Index decorator, not just the createIndexDecorator function.
My solution was to use two fields, one with the correct name for the database (database field) and one virtual field for the code (application field) with magic get/set functions.
my_field = database field
myField = application field

@Table({
  tableName: 'my_table',
  underscored: true,
  defaultScope: {
    attributes: {
      // Exclude the database field on select queries
      exclude: ['my_field'],
    }
  },
})
export class MyModel extends Model<MyModel> {
  @PrimaryKey
  @Column
  id: string;

  @Index
  @Column
  my_field: string;

  @Column({
    type: DataType.VIRTUAL,
    set(myField: string) {
      this.setDataValue('my_field', myField);
    },
    get(): string {
      return this.getDataValue('my_field');
    },
  })
  myField: string;
}

This solution requires some extra code, but the application field will be fully working, just like a normal field. And the database field is persisted and named correctly in the database so when this bug is fixed you just need to remove this workaround code.
Just remember that, with this solution, when creating a new instance of this model, both the database and application fields will be available. Like myInstance.my_field and myInstance.myField, but if you keep the "exclude" part in the defaultScope at least the database field will be excluded from the instance when doing select queries.

Same here. It's about @Index itself, not just others.
I think it is quite critical issue for who has already existing schemas.
It seems to me considering to change sequelize-typescript to TypeORM..

Same here when i'm set underscored property is true (Cuz they missing underscore when create indexing)
It is critical issues on me .. ;

I've found another potential fix for this, by not using the @Index decorator at all but instead just specifying the indices in the @Table decorator instead, and manually specifying the field(s). Like this:
@Table({
  tableName: 'user',
  underscored: true,
  indexes: [
    {
      // Column name with underscores here
      fields: ['first_name'],
    },
  ],
})
export class User extends Model<User> {
  @PrimaryKey
  @Column
  id: string;

  @Column
  firstName: string;
});

I've also been experimenting with a decorator wrapper:
function UnderscoredIndex<T>(target: T, key: string): void {
    annotateModelWithIndex(target, snakeCase(key));
}

If anyone is interested, extended @jessemyers 's solution to a generic decorator, so we could use it with parameters:
declare type IndexDecoratorOptions = IndexOptions & Pick<IndexFieldOptions, Exclude<keyof IndexFieldOptions, 'name'>>;

type AnnotationFunction = <T>(
    target: T,
    propertyName: string,
) => void;

/**
 * Support @UnderscoredIndex('index_name')
 */
export function UnderscoredIndex(name: string): AnnotationFunction;

/**
 * Support @UnderscoredIndex({ name: 'index_name', unique: true })
 */
export function UnderscoredIndex(indexOptions: IndexOptions): AnnotationFunction;

/**
 * Support @UnderscoredIndex
 */
export function UnderscoredIndex<T>(
    target: T,
    propertyName: string,
    indexDecoratorOptions?: IndexDecoratorOptions,
): void;

/**
 * Overloaded decorator to support all variants of @UnderscoredIndex
 */
export function UnderscoredIndex<T>(...args: any[]): AnnotationFunction | void {
    if (arguments.length >= 2) {
        const type: T = <T>args[0];
        const key: string = <string>args[1];
        const indexDecoratorOptions: IndexDecoratorOptions = <IndexDecoratorOptions> args[2];
        annotateModelWithIndex(type, snakeCase(key), indexDecoratorOptions);
    } else {
        return <Type>(target: Type, propertyName: string) => {
            annotateModelWithIndex(target, snakeCase(propertyName), args[0]);
        };
    }
}

Bump

Same issue duplicated at #1424

Fixed as part of the merge of sequelize-typescript in sequelize https://github.com/sequelize/sequelize/pull/15482

I'm still having this problem with sequalize-typescript - 2.1.5

For those of us using @ranhalprin 's solution and using a subset of IndexFieldOptions in the decorator...
export function UnderscoredIndex(indexOptions: IndexOptions): AnnotationFunction;
export function UnderscoredIndex(indexOptions: IndexDecoratorOptions): AnnotationFunction;

still having problem with this on 2.1.6

This issue will not be fixed in sequelize-typescript, but it is fixed in @sequelize/core v7 which has TypeScript as a first class citizen and removes the need for sequelize-typescript. @sequelize/core v7 is still in alpha, but quite stable. Once the first full version is out we will start to deprecate sequelize-typescript

very nice. looking forward to it. Any ETA?


Microsoft .NET Core SDK requires OS X 10.12 or later

Microsoft .NET Core SDK requires OS X 10.12 or later

this clearly is an issue because OS X 10.12 version is not supported for all Apple's currently working products and leads to Apple's income increase, not being a support act for open movement.

https://github.com/dotnet/core/issues/732 has some information about why 10.11 is no longer supported.

Yes, this was a requirement to get rid of the OpenSSL dependency that was a bit of an acquisition nightmare to say the least. Closing this because it was an intentional decision.


How to reload all cells in a single section?

I want to reload the view state of all cells in a single section. How can I do that

if I do this ,app will crash

1

1


Enable mypy for ngclient

Fixes #1409
Description of the changes being introduced by the pull request:
Enable static type checking for ngclient.

add all missing type annotations
fix errors (partially for updater.py and trusted_metadata_set.py
add urllib3 to ignored includes
download suggested stub packages when running mypy

Please verify and check that the pull request fulfills the following
requirements:

[ ] The code follows the Code Style Guidelines
[ ] Tests have been added for the bug fix or new feature
[ ] Docs have been added for the bug fix or new feature

I think there's a few cases here:

TrustedMetadataSet.root probably does not actually need to be Optional: Unlike other signed types it's guaranteed to be a Metadata after constructor, right?
mypy gets confused about target_base_url: I'm sure it's possible to simplify the code so mypy understands that target_base_url cannot be None
many cases of Metadata.Signed typing problem...

I believe this would get fixed with #1457 and Generics
alternatively we could just use calls like assert(self._trusted_set.snapshot) and assert(isinstance(self._trusted_set.snapshot.signed, Snapshot)) where we know they are true. Ugly but works and there aren't that many places where this is needed
even more alternatively we could add properties to TrustedMetadataSet that returned Root, Snapshot, Timestamp and Targets...

First two can be be fixed now. The last one we can discuss... In any case this is useful work as it shows how much (or little) the lack of signed typing affects us...
The download related the changes should maybe only be done after the cleanup is done in #1448 (also the SlowRetrievalError change looks a bit fishy -- I would expect it's used in the legacy code as well?)

mypy gets confused about target_base_url: I'm sure it's possible to simplify the code so mypy understands that target_base_url cannot be None

It's debatable whether this simplifies things for humans reading the code, but I was able to make mypy happy with the following:
        # locally scoped variable that is definitely a string, even if empty
        tgt_base_url: str = self._target_base_url or ""
        if target_base_url is not None:
            tgt_base_url = _ensure_trailing_slash(target_base_url)

        # move the check for a base URL being set to after the locally scoped
        # variable assignment logic is bottomed out.
        if not tgt_base_url:
            raise ValueError(
                "target_base_url must be set in either download_target() or "
                "constructor"
            )

see the full diff here.

this should also work -- the issue for mypy is two branches that seem unrelated (even if they aren't) so making the branches actually same should make the intent clear to computer...
        if target_base_url is None:
            if self._target_base_url is None:
                raise ValueError(
                    "target_base_url must be set in either download_target() or "
                    "constructor"
                )
            target_base_url = self._target_base_url
        else:
            target_base_url = _ensure_trailing_slash(target_base_url)

The download related the changes should maybe only be done after the cleanup is done in #1448 (also the SlowRetrievalError change looks a bit fishy -- I would expect it's used in the legacy code as well?)

#1448 is now merged

Rebased on latest changes in developed and fixed all issues but the Metadata.Signed typing ones.

Actually bandit complains slightly about asserts:
>> Issue: [B101:assert_used] Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.
   Severity: Low   Confidence: High
   Location: tuf/ngclient/updater.py:297
   More Info: https://bandit.readthedocs.io/en/latest/plugins/b101_assert_used.html
296
297	            assert self._trusted_set.snapshot is not None
298	            metainfo = self._trusted_set.snapshot.signed.meta[f"{role}.json"]

Actually bandit complains slightly about asserts

Right. We could reasonably silence those warnings, as we are only suggesting use of asserts to help mypy determine the expected type. But I think this further reinforces the 'code smell' of using asserts to solve this problem.

Actually bandit complains slightly about asserts

Right. We could reasonably silence those warnings, as we are only suggesting use of asserts to help mypy determine the expected type. But I think this further reinforces the 'code smell' of using asserts to solve this problem.

In this case we use assert as the recommended way to deal with None errors. So we either silence bandit or tweak the TrustedMetadataSet public properties to not return optional values.

I used the part of #1457 that makes Metadata 'Generic' to resolve the type checking issues related to the 'signed' type.
Now there are no more mypy errors left and the PR should be ready for review.

Seems like the CI won't be triggered until I rebase and resolve the conflicts.

add urllib3 to ignored includes

If you researched this can you document why? looking in urllib3 git the annotations seem to be there but is that just for some future 2.0 release?

download suggested stub packages when running mypy

Could we add the required stub packages to test requirements instead?

I think it looks good (but obviously the last commits depend on a commit from generics PR #1457 so I'm not approving).

Hmm ... I wouldn't say directly depending, I didn't cherry-pick the commit from the other PR but created a new one and added you as a co-author.

This PR isn't using the whole Generics branch though: if it did then it could just remove all of the checks of type if new_root.signed.type != "root" since the constructor would do that already

This was done intentionally but I guess I should've tried to explain my intentions somewhere in written form.
The "Generics" branch tries to achieve two things simultaneously: correct type annotations of Signed and a runtime check ensuring  content and type are really what we expect. Since there seems to be an agreement already on the use of Generics and an ongoing discussion around the runtime check part, I decided to include only the first part here, the one directly related to type annotations and mypy. This way we can leave the rest of the discussion for #1457 which will also make it simpler because it will try to solve only one problem. I hope you agree :)

The last commit is IMO not great since it has so much code in the try-block: it's not clear that the KeyError should only happen in self.root... I think the original code is better. Maybe the real alternative would be to not call update_root() from init but instead do the required steps in init itself -- that seems ok to me as well as I think there aren't that many steps here.

I tried this alternative since @joshuagl expressed some concerns about not using the 'root' property consistently inside the class. The three options, none of them perfect, would be:

don't call update_root from init, repeat some of the code (not than much repetition so could be acceptable)
don't use the property but "get" safely from self._trusted_set  c205ac0 (concerns about not using consistently the root property)
use the root property, enclose it in a try bock and catch the KeyError 8c172af (well you already described the disadvantages)

There is a forth one where we keep root optional as the rest of the properties and add asserts in the code but I tried and this means asserts at 4-5 places which seems to rule out this option.

I think it looks good (but obviously the last commits depend on a commit from generics PR #1457 so I'm not approving).

Hmm ... I wouldn't say directly depending, I didn't cherry-pick the commit from the other PR but created a new one and added you as a co-author.

This PR isn't using the whole Generics branch though: if it did then it could just remove all of the checks of type if new_root.signed.type != "root" since the constructor would do that already

This was done intentionally but I guess I should've tried to explain my intentions somewhere in written form.

Yeah I think the generics change is major enough that we can't just hide it in a PR titled "enable mypy for ngclient" :) We can definitely split the PR if that makes it easier to swallow though.

Yeah I think the generics change is major enough that we can't just hide it in a PR titled "enable mypy for ngclient" :) We can definitely split the PR if that makes it easier to swallow though.

Ack, let's do it.

add urllib3 to ignored includes

If you researched this can you document why? looking in urllib3 git the annotations seem to be there but is that just for some future 2.0 release?

Yes, the latest release is 1.26 which does not include the type annotations. I updated the commit description.

download suggested stub packages when running mypy

Could we add the required stub packages to test requirements instead?

Done:  d306370

Ok, I've made the #1457 PR into a "minimal generics" PR -- this PR could be based off of that one I believe.


Correct Text for Homepage

Not a priority.

Use this for reference:
https://dallasmakerspace.org/


Custom tags for AMI's and launch configuration options

Additional launch configuration optionss can be specified through parameters ej:
set :aws_autoscale_key_pair, 'key-name'
set :detailed_instance_monitoring, true

Support for custom tags on AMI's creation,  via aws_elbas_ami_custom_tags parameter, ej:
set :aws_elbas_ami_custom_tags, {'Application' => 'app-production'}

Hi thanks for the PR, I am working on 2.0 using aws-sdk v2, I would like to merge this functionality into a final v1 release though. I will be sure to include it in the v2 release as well. Can you fix the tests?

I'm just now coming back to maintain this repository using the new AWS SDK and AWS launch templates. I will not be maintaining the old ELBAS that relied on launch configurations and AWS SDK v1.
The features in this PR are both taken care of by AWS launch templates, so I'll be closing this PR.


Line under header

How do I remove or at minimum shorten the line under the Header?

Sorry for the delay, I just pushed a change that adds a class to that hr so now in your CSS you can do something like.
.date_counter_hr {
  border: 10px solid green;
}

Note:  If you are using multiple instances of the module you would need to reference the parent ids to have specific formatting per instance.


Ruby 2.6.4 support

Essentially the same problem as actions/setup-ruby#8.
Since 2.6.4 is a release for security reasons everyone should be able update ASAP, which gives the topic a certain urgency.
Has anyone found a way to install a specific ruby version manually?
Thanks in advance,
Jo

FWIW https://github.com/eregon/use-ruby-action supports all Ruby 2.6.x versions.


Publish 02/16/2022 3:30 PM PT

Docs Build status updates of commit aa2b613:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

.openpublishing.publish.config.json
:white_check_mark:Succeeded

exchange/docs-conceptual/filters-v2.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Connect-ExchangeOnline.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Enable-App.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Set-MailboxCalendarConfiguration.md
:white_check_mark:Succeeded
View (exchange-ps)

skype/skype-ps/skype/Get-CsOnlineUser.md
:white_check_mark:Succeeded
View (skype-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Feature anywhere create detector flyout page

Description

the pr introduces the create detector flyout page.

Missing stuff that coming up in the next pr:

UTs
Setup Alert button in the toast
Update current success toast message after the Setup Alert button is up
Update plugin.ts file to move dependency plugins from start to setup

Issues Resolved
[List any issues this PR will resolve]
Check List

[ ] New functionality includes testing.

[ ] All tests pass

[ ] New functionality has been documented.
[ ] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Can you call out in description (potentially also TODO comments) if there are any misses or things that we should remember in the PR. like if we decide that i should add more error description to saved object or if we need changes in wording that we are waiting on from UX. Also add a screenshot of the create view to the description

Additionally, we need to have some unit tests here. I'm very concerned about pushing this huge of changes with no tests, otherwise we don't have confidence or control in how the system will behave.

Can you call out in description (potentially also TODO comments) if there are any misses or things that we should remember in the PR. like if we decide that i should add more error description to saved object or if we need changes in wording that we are waiting on from UX. Also add a screenshot of the create view to the description

Updated the Pr description with more info

Additionally, we need to have some unit tests here. I'm very concerned about pushing this huge of changes with no tests, otherwise we don't have confidence or control in how the system will behave.

Will add UTs in the next upcoming pr as it's quick a big page and could take me a while to add them. Wanted to get this merged first to unblock Amit since he needs to add Associated related logic on top of this pr

Additionally, we need to have some unit tests here. I'm very concerned about pushing this huge of changes with no tests, otherwise we don't have confidence or control in how the system will behave.

Will add UTs in the next upcoming pr as it's quick a big page and could take me a while to add them. Wanted to get this merged first to unblock Amit since he needs to add Associated related logic on top of this pr

Ok. As long as we ensure we have them before merging the feature branch to main/2.x. Can consider it a blocker at that time.


User automatic logout after file changes

I am using windows with xammp and Laravel 5.3.0
When change any controller's file then user automatically logout.
Am I doing something wrong or it's who they work?
I am newbie for Laravel.

Changing the file shouldn't logout the user,
Yet check the session time used, since it'll logout when the session expires, inside your config/sessions.php
'lifetime' => 120, //minutes

Also this may be an issue with xampp or your browser generating a new session.

@fernandobandeira  Thank you for quick response.
I have tried with Chrome and FF but still same issue.
And with xammp I am using WordPress but it's working perfectly fine.
Also I have tried to save session on cookie but still same issue.

I've seen this issue with XAMPP before. What we wound up concluding is XAMPP will cache php files when they are used. this means relevant keys, session data, and storage can sit in memory. It then uses a listener to see if a file has been edited and to refresh that cache. If session data is stored in cache it might be refreshing that as well.
Two things I would do to see if this could potentially also be your issue

try to check out where session data is being stored for your laravel app. If its in memory then that could be your issue.
Try setting up the project with laravel homstead and seeing if the issue persists. If so then it more likely is an issue with the code. I dont feel confident that this is a bug that belongs in the framework issues tracker though so I would also recommend joining the laravel slack channel and asking for help in the #questions channel.

I have tried storing session on database, and file and cookies but no luck.
Also one thing need to add CSRF field 80-90% says failed to verify.
So looks like session changed.
I will ask further question on LaraChat. Thanks for suggestion.


Require k8s 1.18 +

Codecov Report

Merging #725 (94fd91f) into main (aaa08ad) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #725   +/-   ##
=======================================
  Coverage   67.57%   67.57%
=======================================
  Files          93       93
  Lines        3719     3719
=======================================
  Hits         2513     2513
  Misses        860      860
  Partials      346      346

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update aaa08ad...94fd91f. Read the comment docs.


feat : check for missing fragment elements

Description
Introduces a check while matching fragment rules, that validates if any of the selectors in rule.containers doesn't return a match in the current document. If so, the rule will be skipped for the current visit.
Makes the PR #47 unnecessary for the use case I'm facing right now. I'd like to keep the rule API surface as small as possible until we stumble on a use case where we really need to expand it. We can keep the rule.if PR open and in sync, should we need it sometime.
Checks

[x] The PR is submitted to the master branch
[x] The code was linted before pushing (npm run lint)
[x] The documentation was updated as required

Is this breaking? Do we care?

I'd say it's not breaking. IMO it was almost a bug as it was before.

Sorry, again please 👔


Add documentation of available steps

Hi,
I'm a new Behat and Mink user and I'm having a difficult time finding out the steps provided by the MinkExtension. A simple page with a list of the steps and their parameters would come handy for a newcomer.
Thanks!

It's impossible to maintain documentation somewhere outside the code.
However code is very good documented, try:
bin/behat -dl
bin/behat -di


Add possibility to specify asciidoctor --require argument

From asciidoctor manual:

-r, --require=LIBRARY
Require the specified library before executing the processor, using the standard Ruby require. This option may be specified more than once.

It is basically the way to specify extensions for asciidoctor to use during rendering and it accepts paths to .rb files.

I would like to implement it but I wonder what would be the best way to implement it?
I see it as a config parameter of array of strings, each item is a path to extension.

Isn't there a global way to configure this for Asciidoctor? Via OS environment or something?

It is the only way to do it for now.


Please invite me to the Community Organization

Name
The-CodeINN
Discord Username (if applicable) E.g John#412
No response
Questions & suggestions?
No response

We are so happy to have you join the community boss @The-CodeINN, welcome to Communitypro. 🙌🏾🤩


chore(examples): add create-next-app example

PR Checklist

[x] Fix linting errors
[x] Label has been added

Change information
Resolves #212

@antoniojps
I didn't make it clear, I mean zeit-ui/react has a component called Page, we can omit a lot of  CSS code if we use Page component.

@antoniojps
I didn't make it clear, I mean zeit-ui/react has a component called Page, we can omit a lot of CSS code if we use Page component.

Yes, I was going to that and forgot.
I didn't use any of the Page.Header, Page.Footer, etc since that might fall out of the scope of a simple example.


Allow adding re-configure dependencies and doing non-matching builds

Additional re-configure dependencies can now be added in the project config. For example, for rb3, we moved object configuration to a pair of objects.json and flags.json files so we can configure things per-version, and edits to these files need to cause a re-configure.
Additionally, a non-matching build can now be performed by passing the --non-matching argument to configure.py. This skips the hash check and progress output, since those don't make sense to run in this configuration. A new Equivalent object status has also been added, which will make an object be built and linked only in this configuration.
I also fixed a small type-checking issue in configure.py, config.version was still an Optional[str] after being set from args.

For non-matching, what about changing the default rule to be the dol instead of neutering the check and progress rules?

Thanks for the PR! I agree with cadmic that adjusting the default target would be more ideal. Otherwise looks good.

For non-matching, what about changing the default target to be the dol instead of neutering the check and progress targets?

I'm not familiar with Ninja, so I never considered this as a possibility. That definitely sounds like a better option.

Looks good, thanks!


Pull v1.0 complete FastAPI + Train/Validation/Inference + DVC

First complete version of the tasks.
(TODO: put all code + env into docker)

Confirm PR


to_parquet is not supported

System information
$ cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.2 LTS"
$ conda --version
conda 4.6.14
$ python --version
Python 3.7.3
$ pip --version
pip 19.1 from /home/dlweber/miniconda3/envs/gis-dataprocessing/lib/python3.7/site-packages/pip (python 3.7)

$ pip freeze | grep modin
modin==0.5.0
$ pip freeze | grep pandas
pandas==0.24.2
$ pip freeze | grep numpy
numpy==1.16.3

miniconda3 was used to install most of the sci-py stack, with a pip clause to add modin, e.g.
# environment.yaml
channels:
  - conda-forge
  - defaults

dependencies:
  - python>=3.7
  - affine
  - configobj
  - dask
  - numpy
  - pandas
  - pyarrow
  - rasterio
  - s3fs
  - scikit-learn
  - scipy
  - shapely
  - xarray
  - pip
  - pip:
    - modin

Describe the problem
https://modin.readthedocs.io/en/latest/pandas_supported.html says to_parquet is supported, but maybe not:
import numpy as np
import modin.pandas as pd
size = (1, 10 * 10)
column_ij = ["%04d_%04d" % (i, j) for i in range(10) for j in range(10)]
data = np.random.randint(0, 10000, size=size, dtype="uint16")
df = pd.DataFrame(data, columns=column_ij)
df.to_parquet('/tmp/tmp.parquet')

UserWarning: `DataFrame.to_parquet` defaulting to pandas implementation.

More details:
2019-05-21 16:03:46,207	WARNING worker.py:1337 -- WARNING: Not updating worker name since `setproctitle` is not installed. Install this with `pip install setproctitle` (or ray[debug]) to enable monitoring of worker processes.
2019-05-21 16:03:46,207	INFO node.py:469 -- Process STDOUT and STDERR is being redirected to /tmp/ray/session_2019-05-21_16-03-46_18437/logs.
2019-05-21 16:03:46,310	INFO services.py:407 -- Waiting for redis server at <IP_ADDRESS>:55558 to respond...
2019-05-21 16:03:46,418	INFO services.py:407 -- Waiting for redis server at <IP_ADDRESS>:41726 to respond...
2019-05-21 16:03:46,420	INFO services.py:804 -- Starting Redis shard with 2.1 GB max memory.
2019-05-21 16:03:46,426	INFO node.py:483 -- Process STDOUT and STDERR is being redirected to /tmp/ray/session_2019-05-21_16-03-46_18437/logs.
2019-05-21 16:03:46,427	WARNING services.py:1304 -- WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only<PHONE_NUMBER> bytes available. This may slow down performance! You may be able to free up space by deleting files in /dev/shm or terminating any running plasma_store_server processes. If you are inside a Docker container, you may need to pass an argument with the flag '--shm-size' to 'docker run'.
2019-05-21 16:03:46,427	INFO services.py:1427 -- Starting the Plasma object store with 6.0 GB memory using /tmp.
UserWarning: Distributing <class 'list'> object. This may take some time.
UserWarning: `DataFrame.to_parquet` defaulting to pandas implementation.
To request implementation, send an email to<EMAIL_ADDRESS>
Maybe modin could be added to conda-forge so that conda can help with resolving version dependencies?

Thanks @darrenleeweber, good point. The documentation is not very clear or consistent about the to_<something> methods. It could use an update once we get #613 merged in. I'll try to dedicate some time to that this week.

Maybe modin could be added to conda-forge so that conda can help with resolving version dependencies?
I'm definitely open to the idea. Does pip cause problems for you in your environment due to package collisions?

Also, the from_parquet is not supported for a partitioned data set.  Same versions as above.

  File "/home/joe/miniconda3/envs/project/lib/python3.7/site-packages/modin/backends/pandas/query_compiler.py", line 871, in _full_reduce
    mapped_parts = self.data.map_across_blocks(map_func)
  File "/home/joe/miniconda3/envs/project/lib/python3.7/site-packages/modin/engines/base/frame/partition_manager.py", line 209, in map_across_blocks
    preprocessed_map_func = self.preprocess_func(map_func)
  File "/home/joe/miniconda3/envs/project/lib/python3.7/site-packages/modin/engines/base/frame/partition_manager.py", line 100, in preprocess_func
    return self._partition_class.preprocess_func(map_func)
  File "/home/joe/miniconda3/envs/project/lib/python3.7/site-packages/modin/engines/ray/pandas_on_ray/frame/partition.py", line 108, in preprocess_func
    return ray.put(func)
  File "/home/joe/miniconda3/envs/project/lib/python3.7/site-packages/ray/worker.py", line 2216, in put
    worker.put_object(object_id, value)
  File "/home/joe/miniconda3/envs/project/lib/python3.7/site-packages/ray/worker.py", line 375, in put_object
    self.store_and_register(object_id, value)
  File "/home/joe/miniconda3/envs/project/lib/python3.7/site-packages/ray/worker.py", line 309, in store_and_register
    self.task_driver_id))
  File "/home/joe/miniconda3/envs/project/lib/python3.7/site-packages/ray/utils.py", line 475, in _wrapper
    return orig_attr(*args, **kwargs)
  File "pyarrow/_plasma.pyx", line 496, in pyarrow._plasma.PlasmaClient.put
  File "pyarrow/serialization.pxi", line 355, in pyarrow.lib.serialize
  File "pyarrow/serialization.pxi", line 150, in pyarrow.lib.SerializationContext._serialize_callback
  File "/home/joe/miniconda3/envs/project/lib/python3.7/site-packages/ray/cloudpickle/cloudpickle.py", line 952, in dumps
    cp.dump(obj)
  File "/home/joe/miniconda3/envs/project/lib/python3.7/site-packages/ray/cloudpickle/cloudpickle.py", line 271, in dump
    raise pickle.PicklingError(msg)
_pickle.PicklingError: Could not pickle object as excessively deep recursion required.

For relatively small data sets, e.g. a 10x10 numpy.ndarray, the overhead of serializing to/from plasma and tracking the objectIDs is killing performance.  A single process using pyarrow directly with pandas is much faster with parquet IO.  Whether or not the pure IO aspects of modin can out-perform pandas/pyarrow is a primary interest - esp. when selecting parquet columns and whether or not modin can perform concurrent reads for parallel reads of parquet.

Does pip cause problems for you in your environment due to package collisions?

Somehow, it's working OK when the pip requirements are bundled into the conda environment.yaml specs.  It seems to have the correct release versions of modin and pandas (as defined in the setup.py for modin).  BTW, it's early days for modin, so I get it, but try to relax the version sem-ver on pandas if possible.

Also, the from_parquet is not supported for a partitioned data set. Same versions as above.

Thanks, would you mind to open a new ticket for this one since it's not related to the original issue? It's fine to just leave a link to your system info on this page, but I prefer to track it separately. If you are able, please also include a way I can reproduce the issue.

For relatively small data sets, e.g. a 10x10 numpy.ndarray, the overhead of serializing to/from plasma and tracking the objectIDs is killing performance.

You're right, the performance on a few hundred bytes of data will be worse, and that's not likely to change much. The difference here is a matter of ~10-20ms (depending on system specs), which is not typically noticeable to the user and should not negatively affect any workflows in a meaningful way in most use cases. There's a chance this could change as we transition to Pyarrow compute kernels, but that would be more of a side-effect because many overheads are fixed, and small data is a solved problem for most of these tools.

BTW, it's early days for modin, so I get it, but try to relax the version sem-ver on pandas if possible.

We pin to a specific pandas version so that the behavior of Modin can be well-defined in the context of that pandas version. Because pandas still has API changes, and the behavior is not consistent between minor versions, we pin to the newest version to make sure we can keep the guarantee of a true drop-in replacement. We don't have the manpower to guarantee this for more than one version, which is why it is pinned.

Let me clarify since it may not have been clear:
Users don't need Modin to process 100's of bytes. Pandas works at a microsecond level in that data range, and it's optimized for that scale (keeping around copies, vectorization, etc.). There's no chance Modin can be faster than pandas on 400 bytes of data because serialization alone will exceed that. Do you have thoughts on this?

pin to sem-ver like 0.x and allow the patch/bug-fix releases like 0.x.y to increment automatically (hope that makes sense)
the modim spin-up costs on import negate any smart-detection of df size to some degree, but it might be possible to directly pass small dfs to pandas
kudos on the easy spin-up for ray (although it would be 💯 + if it could be lazy too)

pin to sem-ver like 0.x and allow the patch/bug-fix releases like 0.x.y to increment automatically (hope that makes sense)

This makes sense, but there are also behaviors that change between versions that can break our tests. E.g. in pandas 0.24.0, functionality was broken that we detected in our tests because the Modin behavior was correct and pandas had a regression. To make it compatible with 0.24.0, we intentionally introduced a regression. We contributed a fix, but that didn't get merged in until 0.24.2.

(although it would be 💯 + if it could be lazy too)

Stay tuned 😄

RE documentation, the dask docs could be relevant to performance advice,

We should do something like this. A list of behaviors to avoid would be great, and it is likely that those same behaviors are also bad in pandas.

for sem-ver releases that are all 0.x.y it should be understood that anything less than 1.x.y is expressly changing the public API for any minor release, so expect a release from 0.23.y to 0.24.y to freely break public APIs, while any release from 0.23.i to 0.23.j to maintain a consistent API while adding features of fixing bugs; I don't know for sure that pandas commits to this sem-ver standard, so, yea, it's safer to pin down to the patch and since pip is very lenient about version conflicts it can fly (but poetry is not so lenient)
I don't really know the full story, but I get the impression that anything in the sci-py stack that depends on numpy will never get to the 1.x.y release until numpy does, since anything that breaks the numpy public API could also break the downstream consumers and necessitate some changes in any pass-through calls; would be easy to think that *args, **kwargs is a catch-all solution, but not likely


[Improvement]: Improve the SQL Shortcuts in Terminal Web UI

Search before asking

[X] I have searched in the issues and found no similar issues.

What would you like to be improved?
Currently, the SQL Shortcuts feature is not user-friendly because it overrides all SQLs in the terminal, causing previous SQLs to be lost.

How should we improve?
Maybe we should append the new SQL demo to the last line instead of overriding all the SQLs.
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Subtasks
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Also, there is currently a lack of a SQL demo on dropping table properties, which should be
ALTER TABLE arctic_catalog.db.sample UNSET TBLPROPERTIES ('read.split.target-size');

Can you assign this issue to me?

Can you assign this issue to me?

Assigned.


Internal Server Error after getting the queue

Is this a bug or a feature request?
A Bug
What happened?
The device transmits uplink but does not receive downlink after changing the server version
What version are your using?
In the state in which the nodes are working, I have used version 2.6.0 and the version in which it does not work is 2.6.1.
How can your issue be reproduced?
I am trying to get the device queue through the API
Could you share your log output?
Maybe it is important to know, that the DevAddr consists of numbers only

That is strange, since nothing changed with regards to the database functions between v2.6.0 and v2.6.1: https://github.com/brocaar/loraserver/compare/v2.6.0...v2.6.1.

I am trying to get the device queue through the API

I make the assumption here that you mean the /api/devices/{dev_eui}/queue endpoint?
What is the LoRa App Server version?

Ah, sorry I wrote into the wrong repository...
This issue should be moved to the lora-app-server.
Now to your questions:

Yes, you are right. I mean the /api/devices/{dev_eui}/queue endpoint

Both LoRaserver and the Applicationserver were deployed in version 2.6.0 and both were changed to 2.6.1.

Are there new information?

I have not been able to reproduce this issue.


Allow replacing configuration properties on ProviderSqlSource

Fixes gh-1057
Please review.

Looks good! Thank you!

@harawata Thanks for your review! I'll merge this.


Full upgrade

Maybe add apt-get upgrade to make RPI-update a complete raspberry pi updater.

I'm using an alias to update firmware and debian pkgs:
alias update='sudo apt-get update && sudo apt-get dist-upgrade && sudo rpi-update'

I don't think rpi-update should use apt-get itself.
Creating an alias or a script is the right option.
Note: rpi-update shouldn't be part of the default update instructions.
rpi-update gives you test firmware. Useful if you want to help with testing, or you need a fix for a newly resolved bug, but otherwise the apt-get firmware is recommended.


Create ARM Templates for Azure Components

Jira Description
Template should:

Link Azure Analysis Services with the Production ODS database
Include an Azure Function to refresh AAS data from the underlying ODS
Include Azure Automation to schedule on/off time for AAS, to save deployment costs (nice to have)

Jira Metadata
Key: BIA-44
Epic: n/a
Created: 2017-03-15T14:08:42.000-0500
Reporter: Dean Goodman

Jira Comment
A requirement of CODS-206 is to integrate the Analytics installer as an option during the CODS installation.  There are some credentials and information that are captured during the CODS installation that can (and should) be shared with the Analytics installer:

SQL Server Connection String - This needs to get injected into the .xmla as the data source prior to deploying the data model to the AAS server.
Resource Group Name
Resource Group Location

Jira Metadata
Created: 2017-03-23T13:03:56.543-0500
Commenter: Dan Malagari

Jira Comment
[~Malagari] As discussed with [~goodmanmd] in the last status meeting, we do not want to integrate the analytics installer as an option in the Cloud ODS deployment - so this ticket (and related ones) should move to the Analytics project. Is is semantics at some point, but we want to keep the Cloud ODS offering distinct from a variety of analytics offerings
cc [~Eric.Jansson], [~cyjones], [~goodmanmd]
Jira Metadata
Created: 2017-03-27T09:48:54.207-0500
Commenter: Chris Moffatt

Jira Comment
Thanks [~Chris.Moffatt], will do.  I was under the wrong understanding that the Analytics installer would be offered as an option during the Cloud ODS installation, thus allowing certain parameters to be passed between the two.  This doesn't impact any of the existing (or current) work, so I'll simply move these tickets under BIA-3.
Jira Metadata
Created: 2017-03-27T09:53:11.053-0500
Commenter: Dan Malagari

Jira Comment
Moved this issue from the CODS project to BIA project.
Jira Metadata
Created: 2017-03-30T13:49:19.977-0500
Commenter: Dan Malagari


Fix Kafka clowder configuration

Description
Fix a minor bug preventing security Kafka configuration to be loaded from Clowder configuration
Type of change

Bug fix (non-breaking change which fixes an issue)

Testing steps
Tested manually in local prepared environment
Checklist

[ ] pre-commit run -a passes
[ ] updated documentation wherever necessary
[ ] added or modified tests if necessary
[ ] updated schemas and validators in insights-data-schemas in case of input/output change

Codecov Report
Attention: Patch coverage is 0% with 2 lines in your changes are missing coverage. Please review.

Project coverage is 85.38%. Comparing base (a7386d3) to head (d3784ca).
Report is 2 commits behind head on main.

Files
Patch %
Lines

ccx_messaging/utils/clowder.py
0.00%
2 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #216      +/-   ##
==========================================
- Coverage   85.59%   85.38%   -0.22%
==========================================
  Files          34       34
  Lines        1194     1197       +3
==========================================
  Hits         1022     1022
- Misses        172      175       +3

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.