[C++] Arrow 13.0.0, python ADBC connection flight server got authentication error

Describe the usage question you have. Please include as many useful details as  possible.
I got an error when using Python ADBC to connect to the flight server implemented in C++.
conn = flight_sql.connect(uri="grpc://<IP_ADDRESS>:xxx", db_kwargs={
            adbc_driver_manager.DatabaseOptions.USERNAME.value: "root",
            adbc_driver_manager.DatabaseOptions.PASSWORD.value: "",
        })
cursor = conn.cursor()
start_time = datetime.now()
cursor.execute(sql)
arrow_data = cursor.fetchallarrow()

> adbc_driver_manager.OperationalError: IO: [FlightSQL] connection error: desc = "transport: Error while dialing: dial tcp <IP_ADDRESS>:9080: connectex: no connection could be made because the target machine actively refused it." (Unavailable; AuthenticateBasicToken)

I implemented flight server in C++ like this:
_header_middleware = std::make_shared<NoOpHeaderAuthServerMiddlewareFactory>();
_bearer_middleware = std::make_shared<NoOpBearerAuthServerMiddlewareFactory>();
flight_options.auth_handler = std::make_unique<arrow::flight::NoOpAuthHandler>();
flight_options.middleware.push_back({"header-auth-server", _header_middleware});
flight_options.middleware.push_back({"bearer-auth-server", _bearer_middleware});

I'm looking for help, thanks!
Component(s)
FlightRPC

no connection could be made because the target machine actively refused it

Are you absolutely sure that the port is correct and that the C++ server is fully active and listening?

Are you absolutely sure that the port is correct and that the C++ server is fully active and listening?

Thx for your reply, port is correct and flight server is normally active.
I used the above python statement to connect successfully on Centos and MacOS, but failed to connect on Windows, adbc_driver_manager Version 0.7
I will verify it on another machine and comment again.

OperationalError                          Traceback (most recent call last)
Cell In[3], line 9
      6 sql = "select * from hdf5 limit 1000000;"
      7 my_uri = "grpc://xxxx:10478"
----> 9 conn = flight_sql.connect(uri=my_uri, db_kwargs={
     10             adbc_driver_manager.DatabaseOptions.USERNAME.value: "root",
     11             adbc_driver_manager.DatabaseOptions.PASSWORD.value: "",
     12         })
     13 cursor = conn.cursor()
     14 start_time = datetime.now()

File ~\anaconda\Lib\site-packages\adbc_driver_flightsql\dbapi.py:120, in connect(uri, db_kwargs, conn_kwargs, **kwargs)
    118 try:
    119     db = adbc_driver_flightsql.connect(uri, db_kwargs=db_kwargs)
--> 120     conn = adbc_driver_manager.AdbcConnection(db, **(conn_kwargs or {}))
    121     return adbc_driver_manager.dbapi.Connection(db, conn, **kwargs)
    122 except Exception:

File ~\anaconda\Lib\site-packages\adbc_driver_manager\_lib.pyx:617, in adbc_driver_manager._lib.AdbcConnection.__init__()

File ~\anaconda\Lib\site-packages\adbc_driver_manager\_lib.pyx:227, in adbc_driver_manager._lib.check_error()

OperationalError: IO: [FlightSQL] connection error: desc = "transport: Error while dialing: dial tcp xxxx:10478: connectex: An established connection was aborted by the software in your host machine." (Unavailable; AuthenticateBasicToken)

On the same LAN, I still get error on Windows. not problem on MacOS. The code is the Python above.
@lidavidm  Ask for advice, Is there any special way to use ADBC on Windows?
adbc_driver_manager version 0.8
adbc_driver_flightsql version 0.8

Is there any Windows Firewall popup or similar? You appear to just be getting generic Windows errors. Are you able to telnet to the server port, or hit it with cURL?

https://github.com/tinode/chat/issues/183 / https://github.com/go-sql-driver/mysql/issues/657 have the same symptoms (Golang, Windows, error message) but different context (it appears to be a long-lived connection); it may still be worth investigating, though.

@lidavidm thank you for the reports, I tried telnet flight server port and it worked, I will research this more.

Completely turned off Windows Defender Firewall and the problem disappeared. Thanks again.


fix: Some tidying and build fixes

Related Issues/PRs

#xxx
What changes are proposed in this pull request?
Briefly describe the changes included in this Pull Request.
How is this patch tested?

[ ] I have written tests (not required for typo or doc fix) and confirmed the proposed feature/bug-fix/change works.

Does this PR change any dependencies?

[ ] No. You can skip this section.
[ ] Yes. Make sure the dependencies are resolved correctly, and list changes here.

Does this PR add a new feature? If so, have you added samples on website?

[ ] No. You can skip this section.
[ ] Yes. Make sure you have added samples following below steps.

Find the corresponding markdown file for your new feature in website/docs/documentation folder.
Make sure you choose the correct class estimators/transformers and namespace.
Follow the pattern in markdown file and add another section for your new API, including pyspark, scala (and .NET potentially) samples.
Make sure the DocTable points to correct API link.
Navigate to website folder, and run yarn run start to make sure the website renders correctly.
Don't forget to add <!--pytest-codeblocks:cont--> before each python code blocks to enable auto-tests for python samples.
Make sure the WebsiteSamplesTests job pass in the pipeline.

/azp run

Codecov Report

Merging #1984 (998fb78) into master (18a2391) will decrease coverage by 4.71%.
The diff coverage is n/a.

:exclamation: Current head 998fb78 differs from pull request most recent head be72fae. Consider uploading reports for the commit be72fae to get more accurate results

@@            Coverage Diff             @@
##           master    #1984      +/-   ##
==========================================
- Coverage   86.26%   81.56%   -4.71%
==========================================
  Files         305      305
  Lines       15993    15993
  Branches      839      839
==========================================
- Hits        13797    13045     -752
- Misses       2196     2948     +752

see 41 files with indirect coverage changes

Acrolinx Scorecards
A minimum Acrolinx score of 80 is required.
Click the scorecard links for each article to review the Acrolinx feedback on grammar, spelling, punctuation, writing style, and terminology.

Article
Acrolinxscore
Word andPhrases Score
CorrectnessScore
Scorecard
Processed

website/docs/documentation/transformers/core/_Train.md
100
100
100
link
:white_check_mark:

More information about Acrolinx

Install Acrolinx locally for VSCode
False positives or issues
Troubleshooting issues with Acrolinx

/azp run

Acrolinx Scorecards
A minimum Acrolinx score of 80 is required.
Click the scorecard links for each article to review the Acrolinx feedback on grammar, spelling, punctuation, writing style, and terminology.

Article
Acrolinxscore
Word andPhrases Score
CorrectnessScore
Scorecard
Processed

website/docs/documentation/transformers/core/_Train.md
100
100
100
link
:white_check_mark:

More information about Acrolinx

Install Acrolinx locally for VSCode
False positives or issues
Troubleshooting issues with Acrolinx

/azp run

Acrolinx Scorecards
A minimum Acrolinx score of 80 is required.
Click the scorecard links for each article to review the Acrolinx feedback on grammar, spelling, punctuation, writing style, and terminology.

Article
Acrolinxscore
Word andPhrases Score
CorrectnessScore
Scorecard
Processed

website/docs/documentation/transformers/core/_Train.md
100
100
100
link
:white_check_mark:

More information about Acrolinx

Install Acrolinx locally for VSCode
False positives or issues
Troubleshooting issues with Acrolinx

Acrolinx Scorecards
A minimum Acrolinx score of 80 is required.
Click the scorecard links for each article to review the Acrolinx feedback on grammar, spelling, punctuation, writing style, and terminology.

Article
Acrolinxscore
Word andPhrases Score
CorrectnessScore
Scorecard
Processed

website/docs/documentation/transformers/core/_Train.md
100
100
100
link
:white_check_mark:

More information about Acrolinx

Install Acrolinx locally for VSCode
False positives or issues
Troubleshooting issues with Acrolinx

/azp run


APIView - review is incorrectly shown as approved for first release

Partner team added a new package for .NET and API review shows the approval status for first preview release as approved when it's actually pending. Since it is already visible as approved in UI, architect cannot mark it as approved.

This is a dup of https://github.com/Azure/azure-sdk-tools/issues/8695


Storyboard Example?

This looks like an awesome and more simplified version of other navigation drawer libraries. I was wondering if you could provide an example using storyboards, since thats a pretty common way for setting up view hierarchies these days.
Thanks!

+1

+1

I do not closely relative to storyboard. Check this commit if somebody can.


Cleanup, improve unit tests and static analysis tests

Q
A

Is bugfix?
❌

New feature?
❌

Breaks BC?
❌

Fixed issues
-

👍


Squash 11 migrations related to connect into 1

What's this PR do?
Consolidates a mess of migrations into a single migration, since they're all Account/Connect related.
Any background context you want to provide?
I discussed the obvious backward compat issues with this approach with @paltman who agrees we should only be striving for backward compat across actual releases.

Nice, therefore it is maybe prematurate as #400 and #413 will bring other schema changes. We are waiting for some PR to get merged before submitting other fixes as well.

What are you waiting on?  I don’t really know what’s blocking what. I want to get a release out this week.

What are you waiting on?

We are waiting some pending pull requests we depend on to be merged, to submit next steps.

I don’t really know what’s blocking what. I want to get a release out this week.

Fine, make the release, just know that connect is not stable yet and other schema changes are expected for a better integration. Everything we think needs to be backported is in #440. That's more or less what's needs to be done. That said, there is no blocker for a release this week, I trust you'll do what is best.

Can you give me a list of PRs? Hard for me to tell from that big 440.

All I can see is that #440 is a massive PR with 150 commits.  I realize this is intended to be an integration branch, but it's not obvious to me what pull requests are in there that are blocking things.  I'd like to give some attention to them tomorrow so we can get this moving along but I need some help in figuring out what those are.  /cc @ticosax @blueyed

@paltman
I think it does not really belong here, and we had this discussion at least once already somewhere else.. what about a meta issue?
As for the list, I think it is basically https://github.com/pinax/pinax-stripe/pulls/blueyed and https://github.com/pinax/pinax-stripe/pulls/ticosax, but we're still in the testing phase and there are still more issues that need to be fixed and will turn up.
#440 is not a PR, but meant as an easy way to compare the changes (https://github.com/pinax/pinax-stripe/pull/440/files).

As for the process of squashing the migrations, you might want to actually create a squashed migration on top of the existing ones.
You could then still decide to only ship the squashed migration in the release.

A big change would be the UserAccount through model (https://github.com/pinax/pinax-stripe/pull/440/files#diff-90b0e5e37b96af44d789c587800e86c0R234).

@blueyed Yes, I remember you had suggested creating a meta issue and I thought I had +1'd it.  I am not really in the position of creating it as I don't know what I'd put in it.  I really am relying on you guys to tell me what needs to be wrapped up for the connect support as I'm not using the feature anywhere yet.

I am confused though about you guys saying connect support isn't ready because @lukeburden is using what he's done, so it's at least working for some.
I'd like to focus on getting done for connect support items that will make a subsequent release to tighten it up harder, which the only thing i can really think of is migration work.  I treat master as something that can always change and am only really concerned with migrations working between releases.

not really in the position of creating it as I don't know what I'd put in it.

It can be edited / commented on, right?

connect support isn't ready because @lukeburden is using what he's done

Well, it depends on what you are using then apparently.. ;)
For example, event processing was broken very hard in case you are using sources (which is done when using the Android SDK).  The same applies to Subscriptions if you are using them with a Connect account, etc.
I/We do not want to block a release of course, we're just trying to help.
Given that you hard-squash all the migrations we'll have to probably keep a fork just because of that anyway then.

No, let's avoid you having to maintain a fork.  Are you running off of master?  Is that why you'd maintain a fork?

We're running off of next.

Ok, I'm happy to work with you so you don't have to maintain a fork.
Are you only merging PRs into next or are some commits getting pushed directly to that branch?

I am pushing my stuff to "pinax" first as a rule of thumb, but there are things in there based on "next" - a bigger one is Coupons for example and the UserAccounts stuff, of course.
I've pulled some stuff out of there already, but it is messy indeed.
I do not think that it is a problem for us to maintain a fork after all.. - I am trying to push / contribute everything back, but it is very exhausting.

And I will unsubscribe from this PR now: it is not the right place to discuss this.


Request for Feature: How to close all opened Realm Instances

There is a closeLocalInstance in RealmManager and of course, it caught exception if there isn't any open Realm:
if(realm == null || realm.isClosed()) {
            throw new IllegalStateException(
                    "Cannot close a Realm that is not open.");
        }

Anyway, how to close all opened Realm Instances by calling just one method?
One of its usages is when we're going to use Realm.deleteRealm(); We have to close all instances before calling this, otherwise, an exception will be thrown without deleting anything.

Thank you, but how to prevent such this problem? Is it possible to handle it in a way that requests for closing the open Realm instances and waiting for them to do their jobs?
You know, I think it's a simple request from a  Manager(RealmManager) to handle such this; Request for remove whole Data, but wait for open Realm instances to finish their jobs.

You see, the tricky part isn't waiting for Realm instances to finish jobs because they are thread-local, the tricky part is that if you initialize your views in onCreate() which I usually do, then you'll only reset them when the Activity is recreated.
Or if you implement a "reset" for your RealmResults and stuff.
So this isn't I can do, but it's burden on whoever wants to close Realms they are using.

Agreed :white_check_mark:


[TASK] Make thruster interface runnable without I2C

Description of task
Launching thruster interface should not crash when you are running the code on something that isnt the drone.
Suggested Workflow

[ ] Add a try except or something

Specifications

[ ] Thruster interface runs on machine without I2C connection.

Contacts
No response
Code Quality

[ ] Every function in header files are documented (inputs/returns/exceptions)
[ ] The project has automated tests that cover MOST of the functions and branches in functions (pytest/gtest)
[ ] The code is documented on the wiki (provide link)

Made it run withouth I2C. Maybe in the future I can document the header files and such or write a wiki page, @IbixD97 future project?


Custom Go Plugins causes kong config db_import CLI failure

Summary
Good Day, we have made a simple Kong plugin and would like to import some configurations using the CLI command
kong config --v db_import /tmp/kong_api_config.yaml. Unfortunately this command fails when the custom go-plugin is added to the env var.
Kong can start but the failure on db_import means no setup was done.
To note the plugin works fine when routing.
Steps To Reproduce

Create a custom go plugin
Add it to the active plugins list KONG_PLUGINS=bundled,custom-go-plugin
Create a db_import file
Run db_import command using kong cli

Kong version:  kong:2.1.4-alpine - Running in docker.

Logs:
2020/10/06 17:04:24 [verbose] Kong: 2.1.4
Error:
/usr/local/share/lua/5.1/kong/db/dao/plugins/go.lua:42: attempt to index upvalue 'kong' (a nil value)
stack traceback:
        /usr/local/share/lua/5.1/kong/db/dao/plugins/go.lua:42: in function 'is_on'
        /usr/local/share/lua/5.1/kong/db/schema/plugin_loader.lua:184: in function 'load_subschema'
        ...are/lua/5.1/kong/db/schema/others/declarative_config.lua:222: in function 'load_plugin_subschemas'
        ...are/lua/5.1/kong/db/schema/others/declarative_config.lua:234: in function 'load_plugin_subschemas'
        ...are/lua/5.1/kong/db/schema/others/declarative_config.lua:730: in function 'load'
        /usr/local/share/lua/5.1/kong/db/declarative/init.lua:37: in function 'new_config'
        /usr/local/share/lua/5.1/kong/cmd/config.lua:82: in function 'cmd_exec'
        /usr/local/share/lua/5.1/kong/cmd/init.lua:88: in function </usr/local/share/lua/5.1/kong/cmd/init.lua:88>
        [C]: in function 'xpcall'
        /usr/local/share/lua/5.1/kong/cmd/init.lua:88: in function </usr/local/share/lua/5.1/kong/cmd/init.lua:45>
        /usr/local/bin/kong:9: in function 'file_gen'
        init_worker_by_lua:49: in function <init_worker_by_lua:47>
        [C]: in function 'xpcall'
        init_worker_by_lua:56: in function <init_worker_by_lua:54>
2020/10/06 17:04:24 [verbose] prefix in use: /usr/local/kong

The issue seems to be originating from:
https://github.com/Kong/kong/blob/254deec3cceef78654a1cba6eb32798c417e993a/kong/db/dao/plugins/go.lua#L42
Where the global variable kong is nil when running db_import for some reason.

Suggested fix:
Creating new kong global instance:
https://github.com/Kong/kong/blob/254deec3cceef78654a1cba6eb32798c417e993a/kong/cmd/config.lua#L87
Before calling declarative.new_config here:
https://github.com/Kong/kong/blob/254deec3cceef78654a1cba6eb32798c417e993a/kong/cmd/config.lua#L82


Merge #334 into main.

This PR merges the completed feature work from #334 into main.

Just a quick note: The failure in the test_selenium job appears to be some intermittent NuGet service issue; I am assuming that will pass on a re-run.

Just a quick note: The failure in the test_selenium job appears to be some intermittent NuGet service issue; I am assuming that will pass on a re-run.

Sounds good, thanks for pointing that out. Will re-run that test once the other tests have completed (the re-run option is disabled until then, sadly).


Introduce clang-tidy-review action

This PR added clang-tidy-review action which helps us to review
our PR's automatically on code style. Also added generate_compile _commands.sh script which generates compile_commands.json. (data-
base for compile options, needed for clang-tidy).

Should this be closed?


Update front page docs to include Python 3.9 support

Context
It appears Zappa supports supports 3.9 but front page doesn't mention that. This made me think twice about using this wonderful framework. Maybe I am wrong?
Also, when filing this Issue there is this statement in the issue generator itself:
"<!- Also, please make sure that you are running Zappa from a virtual environment and are using Python 3.6/3.7/3.8  >"
and maybe that should include 3.9 as well.
Expected Behavior
The front page docs should include Python 3.6/3.7/3.8/3.9
Actual Behavior
The front page docs mention Python 3.6/3.7/3.8/ but it looks like Zappa supports 3.9
Possible Fix
Change this sentence
Before you begin, make sure you are running Python 3.6/3.7/3.8
to
Before you begin, make sure you are running Python 3.6/3.7/3.8/3.9
as it now looks like Zappa supports 3.9

This has now been resolved


Typo fixes #2373

@xavijam CR this, please.

retest this please

Frontend tests were OK :+1: (details)

:+1:


Attempting to shade scala-logging dependency

This issue was encountered while we were attempting to shade the com.typesafe.scala-logging classes in an effort to get RasterFrames running in DataBricks environment. DataBricks itself brings ins com.typesafe.scala-logging version 2.1.2 on the class path which is not binary compatible with version 3.9.0 used by RasterFrames and will result in InstantiationException
Reproduce
The failure to shade can be reproduced locally and shows ups as a failed import.
The attempt is done against current develop by trying to hook into the mechanism in RFAssemblyPlugin
diff --git a/project/RFAssemblyPlugin.scala b/project/RFAssemblyPlugin.scala
index 8f69776f..223257a2 100644
--- a/project/RFAssemblyPlugin.scala
+++ b/project/RFAssemblyPlugin.scala
@@ -53,7 +53,8 @@ object RFAssemblyPlugin extends AutoPlugin {
         "com.amazonaws",
         "org.apache.avro",
         "org.apache.http",
-        "com.google.guava"
+        "com.google.guava",
+        "com.typesafe.scalalogging"
       )
       shadePrefixes.map(p ⇒ ShadeRule.rename(s"$p.**" -> s"rf.shaded.$p.@1").inAll)
     },

Then creating assembly using:
sbt  'project pyrasterframes' assembly

Inspecting the assembly jar we see the shading took effect:
~/p/r/p/t/scala-2.11 ❯❯❯ unzip -l pyrasterframes-assembly-0.8.0-SNAPSHOT.jar | grep scalalogging                             develop ✚ ✱
        0  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/
      590  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/CanLog$class.class
      888  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/CanLog.class
     1002  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LazyLogging$class.class
      589  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LazyLogging.class
     3875  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/Logger$.class
    15727  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/Logger.class
     5104  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anon$1.class
     2766  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$1.class
     1366  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$2.class
     1604  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$3.class
     2196  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$4.class
     2203  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$debugMessageArgs$1.class
     2251  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$debugMessageArgsMarker$1.class
     2202  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$errorMessageArgs$1.class
     2250  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$errorMessageArgsMarker$1.class
     6090  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$formatArgs$1.class
     2199  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$infoMessageArgs$1.class
     2248  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$infoMessageArgsMarker$1.class
     2203  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$traceMessageArgs$1.class
     2252  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$traceMessageArgsMarker$1.class
     2199  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$warnMessageArgs$1.class
     2247  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$$anonfun$warnMessageArgsMarker$1.class
    31565  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro$.class
     9902  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerMacro.class
    13906  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicit.class
     2292  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro$$anonfun$debugMessageArgs$1.class
     2340  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro$$anonfun$debugMessageArgsMarker$1.class
     2291  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro$$anonfun$errorMessageArgs$1.class
     2339  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro$$anonfun$errorMessageArgsMarker$1.class
     2289  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro$$anonfun$infoMessageArgs$1.class
     2337  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro$$anonfun$infoMessageArgsMarker$1.class
     2292  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro$$anonfun$traceMessageArgs$1.class
     2340  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro$$anonfun$traceMessageArgsMarker$1.class
     2288  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro$$anonfun$warnMessageArgs$1.class
     2337  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro$$anonfun$warnMessageArgsMarker$1.class
    46510  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro$.class
    11097  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/LoggerTakingImplicitMacro.class
     1030  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/StrictLogging$class.class
      689  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/StrictLogging.class
      449  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/package$.class
      667  08-15-2019 18:38   rf/shaded/com/typesafe/scalalogging/package.class

Trying to use the assembly goes south:
~/p/r/p/t/scala-2.11 ❯❯❯ spark-shell --jars /Users/eugene/proj/rasterframes/pyrasterframes/target/scala-2.11/pyrasterframes-assembly-0.8.0-SNAPSHOT.jar
19/08/17 13:12:36 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
Spark context Web UI available at http://<IP_ADDRESS>:4040
Spark context available as 'sc' (master = local[*], app id = local-1566061963577).
Spark session available as 'spark'.
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.4.3
      /_/

Using Scala version 2.11.12 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_211)
Type in expressions to have them evaluated.
Type :help for more information.

scala> import org.locationtech.rasterframes._
<console>:23: error: Symbol 'type <none>.scalalogging.LazyLogging' is missing from the classpath.
This symbol is required by 'package org.locationtech.rasterframes.package'.
Make sure that type LazyLogging is in your classpath and check for conflicting dependencies with `-Ylog-classpath`.
A full rebuild may help if 'package.class' was compiled against an incompatible version of <none>.scalalogging.
       import org.locationtech.rasterframes._
              ^

Trying to see what is going on in package org.locationtech.rasterframes.package everything seems hunky-dory:
~/p/r/p/t/s/j/o/l/rasterframes ❯❯❯ javap package\$                                                                                develop ✚ ✱
Warning: Binary file package$ contains org.locationtech.rasterframes.package$
Compiled from "rasterframes.scala"
public final class org.locationtech.rasterframes.package$ implements org.locationtech.rasterframes.StandardColumns,org.locationtech.rasterframes.RasterFunctions,org.locationtech.rasterframes.util.ZeroSevenCompatibilityKit$RasterFunctions,org.locationtech.rasterframes.extensions.Implicits,org.locationtech.rasterframes.jts.Implicits,org.locationtech.rasterframes.encoders.StandardEncoders,org.locationtech.geomesa.spark.jts.DataFrameFunctions$Library,rf.shaded.com.typesafe.scalalogging.LazyLogging {
  public static final org.locationtech.rasterframes.package$ MODULE$;
  public static {};
  public rf.shaded.com.typesafe.scalalogging.Logger logger();
  public org.apache.spark.sql.TypedColumn<java.lang.Object, org.locationtech.jts.geom.Geometry> st_translate(org.apache.spark.sql.Column, org.apache.spark.sql.Column, org.apache.spark.sql.Column);

Note that it implements the shaded version rf.shaded.com.typesafe.scalalogging.LazyLogging

@echeipesh I wonder if some of this has to do with Scala logging using macros? Maybe an argument to get rid of it, and just use Java APIs?
If you're willing to try something, find any places where a package.scala class inherits from LazyLogger, and remove it, replacing call sites with something in the companion class or whatever... just to see if

@echeipesh Also, what version of Java is that running under?

I would say that figuring out how to shade this dependency would be enough.
I don't have arguments to get rid of scala logging:
It is more performant: inlines calls and makes calls to the underlying logger only in case the warning level allows it (sounds a bit naive but even these two things will reduce logging overhead).

@metasim This is all on Java 1.8
Based on your hunch removing the inheritance of LazyLogger from rasterframes package did the trick:
diff --git a/core/src/main/scala/org/locationtech/rasterframes/rasterframes.scala b/core/src/main/scala/org/locationtech/rasterframes/rasterframes.scala
index 1517e8f0..2b908c7f 100644
--- a/core/src/main/scala/org/locationtech/rasterframes/rasterframes.scala
+++ b/core/src/main/scala/org/locationtech/rasterframes/rasterframes.scala
@@ -21,7 +21,7 @@

 package org.locationtech
 import com.typesafe.config.ConfigFactory
-import com.typesafe.scalalogging.LazyLogging
+import com.typesafe.scalalogging.Logger
 import geotrellis.raster.isData
 import geotrellis.raster.{Tile, TileFeature}
 import geotrellis.spark.{ContextRDD, Metadata, SpaceTimeKey, SpatialKey, TileLayerMetadata}
@@ -33,6 +33,7 @@ import org.locationtech.rasterframes.encoders.StandardEncoders
 import org.locationtech.rasterframes.extensions.Implicits
 import org.locationtech.rasterframes.model.TileDimensions
 import org.locationtech.rasterframes.util.ZeroSevenCompatibilityKit
+import org.slf4j.LoggerFactory
 import shapeless.tag.@@

 import scala.reflect.runtime.universe._
@@ -43,8 +44,10 @@ package object rasterframes extends StandardColumns
   with Implicits
   with rasterframes.jts.Implicits
   with StandardEncoders
-  with DataFrameFunctions.Library
-  with LazyLogging {
+  with DataFrameFunctions.Library {
+
+  @transient
+  protected lazy val logger: Logger = Logger(LoggerFactory.getLogger(getClass.getName))

   @transient
   private[rasterframes]

I have not tested it on DataBricks yet, but this produces an assembly where the imports of RasterFrame packages happens fine. I'll keep you posted.

Reproduced. I'll go ahead and fix this and any similar cases.

A bit further, but serialization error (despite transient??):
$ spark-shell --jars  /Users/sfitch/Coding/OSS/locationtech-rasterframes/pyrasterframes/target/scala-2.11/pyrasterframes-assembly-0.8.1-SNAPSHOT.jar
...

Spark context available as 'sc' (master = local[*], app id = local-1566321608265).
Spark session available as 'spark'.
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.3.3
      /_/

Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_171)
Type in expressions to have them evaluated.
Type :help for more information.

scala> import org.locationtech.rasterframes._
import org.locationtech.rasterframes._
scala> import org.locationtech.rasterframes.datasource.raster._
import org.locationtech.rasterframes.datasource.raster._
scala> val rf = spark.read.raster.load("https://s22s-test-geotiffs.s3.amazonaws.com/luray_snp/B02.tif")
java.lang.AssertionError: assertion failed: unsafe symbol Logger (child of package scalalogging) in runtime reflection universe
	at scala.reflect.internal.Symbols$Symbol.<init>(Symbols.scala:184)
	at scala.reflect.internal.Symbols$TypeSymbol.<init>(Symbols.scala:3009)
	at scala.reflect.internal.Symbols$ClassSymbol.<init>(Symbols.scala:3201)
	at scala.reflect.internal.Symbols$StubClassSymbol.<init>(Symbols.scala:3496)
	at scala.reflect.internal.Symbols$Symbol.newStubSymbol(Symbols.scala:498)
	at scala.reflect.internal.pickling.UnPickler$Scan.readExtSymbol$1(UnPickler

...

Calling spark.withRasterFrames triggers it too.

Caught the exception in the debugger after commenting out RF code triggering the AssertionError, and maybe (?) anything inheriting from LazyLogging has a problem? In the backtrace below, error occurred when Scala Reflection was attempting to resolve the type structure for Tile.

Found this message on the stack in a frame further up, which makes me wonder if shading did't transform all references in all libraries:
missing or invalid dependency detected while loading class file 'geotrellis.raster.Tile'.
Could not access type LazyLogging in package com.typesafe.scalalogging,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'geotrellis.raster.Tile' was compiled against an incompatible version of com.typesafe.scalalogging.

Ran javap directly:
$ javap -cp  /Users/sfitch/Coding/OSS/locationtech-rasterframes/pyrasterframes/target/scala-2.11/pyrasterframes-assembly-0.8.1-SNAPSHOT.jar geotrellis.raster.Tile | grep scalalogging
public interface geotrellis.raster.Tile extends geotrellis.raster.CellGrid, geotrellis.raster.IterableTile, geotrellis.raster.MappableTile<geotrellis.raster.Tile>, rf.shaded.com.typesafe.scalalogging.LazyLogging {

and in the spark-shell:
$ echo ':javap geotrellis.raster.Tile' | spark-shell --jars  /Users/sfitch/Coding/OSS/locationtech-rasterframes/pyrasterframes/target/scala-2.11/pyrasterframes-assembly-0.8.1-SNAPSHOT.jar | grep scalalogging
public interface geotrellis.raster.Tile extends geotrellis.raster.CellGrid, geotrellis.raster.IterableTile, geotrellis.raster.MappableTile<geotrellis.raster.Tile>, rf.shaded.com.typesafe.scalalogging.LazyLogging
    #3 = Utf8               Ljava/lang/Object;Lgeotrellis/raster/CellGrid;Lgeotrellis/raster/IterableTile;Lgeotrellis/raster/MappableTile<Lgeotrellis/raster/Tile;>;Lrf/shaded/com/typesafe/scalalogging/LazyLogging;
   #12 = Utf8               rf/shaded/com/typesafe/scalalogging/LazyLogging
   #13 = Class              #12           // rf/shaded/com/typesafe/scalalogging/LazyLogging
Signature: #3                           // Ljava/lang/Object;Lgeotrellis/raster/CellGrid;Lgeotrellis/raster/IterableTile;Lgeotrellis/raster/MappableTile<Lgeotrellis/raster/Tile;>;Lrf/shaded/com/typesafe/scalalogging/LazyLogging;

and both show all references as having been shaded. :-/

I think the problem might have something to do with Spark making heavy use of Scala TypeTags, which are compile-time generated constructs, likely reflecting the type paths as they were at compile time.

@echeipesh I'm worried that this problem isn't solvable without removing LazyLogging from Tile. My current theory is that you can't shade any type that is processed by the Spark SQL Encoder subsystem due to its dependency on compile-time TypeTags. Since Tile is core to RasterFrames, it's hard to see a workaround on this side of the fence, except perhaps some variant of this:
https://stackoverflow.com/a/40404371/296509
I'm not a fan because it means RasterFrames is essentially requiring an isolated version of  GeoTrellis that has scalalogging shaded for it before its used by RasterFrames.

Branch with moving LazyLogging around in RasterFrames.
https://github.com/s22s/rasterframes/commit/c07ccea238b900473eb471b7b97b99549e6ceca8


feat:[CORE-1653] Standardize asset display names which are same for different sources

Description

different cloud providers have assetTypes that have similar name and those are displayed on UI with (cloudtType) as suffix.
we are removing the cloudType suffix for the assetTypes with same names, so that the assets of multiple cloud sources can be selected with a common display name.

Problem
different cloud providers have assetTypes that have similar name and those are displayed on UI with (cloudtType) as suffix
Solution

remove the suffixed cloud provider name for the colliding asset names in cf_Target table, so that they are displayed under single name in Ui
rename the taegetTypeDisplayName in ES to remove the suffix(ES script attached in the ticket)

Fixes # (issue if any)
Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Chore (no code changes)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also
list any relevant details for your test configuration

[ ] run the sql script to update the display names of assets
[ ] run the ES queries attached in the jira ticket
[ ] verify that the asset names are displayed on UI without the suffix

Checklist:

[ ] My code follows the style guidelines of this project
[ ] My commit message/PR follows the contribution guidelines of this project
[ ] I have performed a self-review of my code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes

Other Information:
List any documentation updates that are needed for the Wiki

Before fix:

After fix:


modifiy HostnameInstanceIdGenerator.java

config
org.quartz.scheduler.instanceId =AUTO
When the host name cannot be obtained, it is recommended to generate one randomly

Hello! Thank you very much for your contribution and interest in helping improve the Quartz community.
After a period of dormancy, the Quartz project is back under steady maintenance by multiple volunteers, who are working to once again handle contributions such as yours.
We notice that your contribution was made without use of the DCO feature (the sign-off feature on commits via the -s option). Can you please update your PR with commits that use the -s option, agreeing to assign copyright ownership and other terms as described at the contributor agreement referenced here: https://github.com/quartz-scheduler/contributing/blob/main/CONTRIBUTING.md
You can easily add signoff to your previous commits by running (on your PR branch):
git commit --amend --signoff --no-edit
git push -f

Or (for multiple commits):
# change 5 to the number of commits
git rebase HEAD~5 --signoff
git push -f


Implement renaming and removing students

Removing a student removes their name from the lobby, but when the round begins, they are still very much a part of it from what I can see. It's interesting, because they are not assigned a bee... but they still have an AR view. I propose that we need to look into what happens from the student side of things. I would be okay with approving this aspect and creating a new issue for removing the student from the session and handling what happens to the student's view in that case, but I don't think this should move ahead without something in place for that.

@kklamberty Joe and I have tested this and realized that it's not actually an issue. Students who are removed from a session will always sit at the "Waiting for round to begin" screen. The reason you were able to see the round start was because you were testing the teacher and student side in the same browser session so both of them were actually the same user ID, so even after removing the student it could still read the round because it was actually the teacher as well.

@kklamberty @audreylemeur We have just added a dialog that appears on the student side when they are removed from a session. Also we fixed the student display's "invalids session" message when trying to load a session that either doesn't exist or you don't have access to.


This app will be the next Spotify <3

I fking loved this app.  Jan 11., Mon at 4:31, Hashir Sarwar<EMAIL_ADDRESS>wrote:

I fking loved this app.
Reply to this email directly, view it on GitHub
https://github.com/daudiqbal1/Songs-Database/issues/1, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AR52D4S34B7BH45HFUA5QT3SZJWJVANCNFSM4V466BAA
.

Sarya na sarya na sarya na kr
Tu mera putt chutti kr
On 2021. Jan 11., Mon at 4:31, Hashir Sarwar<EMAIL_ADDRESS>wrote:

I fking loved this app.
Reply to this email directly, view it on GitHub
https://github.com/daudiqbal1/Songs-Database/issues/1, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AR52D4S34B7BH45HFUA5QT3SZJWJVANCNFSM4V466BAA
.


⚠ Bofrost.fr has degraded performance

In d2eb7a8, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1054 ms

Resolved: Bofrost.fr performance has improved in 64c0257 after 6 minutes.


Spelling correction

Regarding the phrase: "When upgrading from a version of Azure MFA Server older than 8.0 to 8.0+ that the mobile app web service can be uninstalled after the upgrade"
Is should be "....older than 8.0 to 8.0+ THEN the mobile app web service can be uninstalled...."

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 86e190f4-0027-f42f-68ec-7d6a9a3975ae
Version Independent ID: e7cd369b-eb6f-eefb-d96b-da5888d7ce74
Content: Upgrading Azure MFA Server - Azure Active Directory
Content Source: articles/active-directory/authentication/howto-mfaserver-deploy-upgrade.md
Service: active-directory
Sub-service: authentication
GitHub Login: @MicrosoftGuyJFlo
Microsoft Alias: joflore

@woodyard If you would like to propose an edit using the edit button at the top of the doc I am happy to approve this change. Otherwise I will get to it when I get some free time later this week.

Thanks for pointing this out, @woodyard .
I made a pull request to add the change but feel free to make your own if you'd like to get credit. https://github.com/MicrosoftDocs/azure-docs-pr/pull/85254


Gather resource usage on master every 10s

This is to address https://github.com/kubernetes/perf-tests/issues/694.
It's enough to scrape more often only on master as when it comes to nodes'components we scrape them much more often on average, e.g. for 100 node cluster we have 100 times more data for nodes components as each node is scrape separately every 60s.
In addition it should be safe to hit cadvisor every 10s on master due to two reasons:

We do it already via prometheus every 5s (and it doesn't seem to be impacting master's performance at all)
From the tests I run looks like cadvisor updates every ~10-16s and request are fast (~100ms), so it implements caching and requests are cheap and in addition there is no gain in scraping it often than 10s

/hold
It's not a good idea to submit this on Friday, let's wait till Monday

I'm fine with that, but let's wait with merging until Monday.
/lgtm

/hold cancel
@oxddr, FYI


Windows Host app saved image size

Dear All,
We'are working with the Arducam-mini-2MP (OV2640) and Arducam Library:
if we configure the library to take 160x120 bitmap image, we noticed that in general
each image is about 37kb.
But, if we launch the Windows Arducam host app, with the same configuration (so, 160x120 without any particular special effect) the saved images are about 2kb.
Could someone explian us this?
Is the Host app that, maybe, automatically compress the images received from the arduino?
Thank you very much,
Bye
Marco

@marcogovo
Sorry for our ArduCAM_Host_V2's bug. Indeed, The ArduCAM_Host_V2 stored image in jpeg format without BMP.You can use our old software https://github.com/ArduCAM/Arduino/raw/master/ArduCAM/examples/host_app/ArduCAM_host_v1.0.exe

Hi,
Thank you for the response.
There is not a bug in the Host App, my question is only about the image size.
In few words:
-1 ) if we configure only the Arducam library on the Arduino, in order to take 160x120 images in JPEG format, and we save the image for example on a SD card, this image is about 37kb.
-2) Now we launch the Host App on Windows, with the Arduino connected on the serial port, and the Arducam mini example configured with 160x120 image format and jpeg; so the same configuration of the previous test. But in this case, the image saved on the PC by the Host App is about 2kb.
So, our problem is why the image saved by Host App is so small, respect the image produced only if we use the Arduino+Arducam.
I hope my question now is clearer.
Marco

@marcogovo
Sorry for my misunderstanding of your meaning. Now I know what you mean.Don't worry and tomorrow
I will help you test and give you a reply as so as quickly.

@supprot thank you very much,
Marco

@marcogovo
Hi,
I have tested it and anything is normal. Can you send us your image?

Dear @supprot,
I attached a .zip  file with the following images:
160x120-arduino.bmp : 38.5 KB
160x120-win-host.jpg: 3.4 KB
160x120-win-host.bmp: 3.4 KB
We verified that the Windows-Host-App-V2 saves images only in JPEG format, infact
the two win-host images (both .bmp and .jpeg) have the same size and are both JPEG Images.
For us this is not a problem, because out intention is to use only an Arduino + Arducam library.
But for now, we are able only to capture BMP images with just Arducam;
How can we capture and compess the image, obtaining pure JPEG images with Arducam?

Thanks @supprot ,
At this point, how we can configure the Arducam Library to send JPEG images , instead BMP?
Because in the Arducam examples, the Arduino sends over serial always a BMP header + data.

Thanks,
But i don't want to use the Host App,  i only used it for testing the image formats.
What i would to implement now is only with an Arduino + ArduCam, in order to
send over serial JPEG images (not BMP), and receive them with a custom Python script.
I hope to make my situation clearer.

@marcogovo
Hi,
OK, the Arducam and arduino send over serial JPEG images is very easy. You just need to change our video streaming demo.
In our demo , we start capture when the arduino receive 0x10. You can change it for your project.

@supprot ok, i understand.
Give me some time to test the new sketch with our python script,
and i'll go back to you with a feedback..
Thank you very much,
Marco

@UCTRONICS
Thank you very much ;)
Marco


[2.10] Have both cleanup scripts reference their yml from the current branch

Backport of https://github.com/rancher/rancher/pull/48318
Issue: Discovered during QA testing of https://github.com/rancher/rancher/issues/43343
Works towards resolving https://github.com/rancher/rancher/issues/47402
Testing
Repro steps in https://github.com/rancher/rancher/issues/43343 are valid, specifically workarounds in this comment should no longer be required

Test Environment

Component
Version / Type

Rancher version
v2.10-33fc602feb5f335943023ce0645e523ed0d2d7e9-head

Installation option
Docker

Docker version
v27.1.2

Helm version
v2.16.8-rancher2

Logged in user role
Admin

Dashboard
release-2.10 3221965

#
Description
PASS/FAIL

1
Run cleanup Rancher Components script
✅ PASS

Run cleanup Rancher Components script

Create and Import the RKE Cluster to Rancher.
Download the script for this version (v2.10)

$ curl -o user-cluster.sh https://raw.githubusercontent.com/rancher/rancher/refs/heads/release/v2.10/cleanup/user-cluster.sh

Run user-cluster.sh

$ chmod +x user-cluster.sh
$ ./user-cluster.sh rancher/rancher:v2.10-head

For previewing the script's outcome without making changes, add the flag: -dry-run

Outcome

Command Output

serviceaccount/cattle-cleanup-sa created
clusterrolebinding.rbac.authorization.k8s.io/cattle-cleanup-binding created
job.batch/cattle-cleanup-job created
clusterrole.rbac.authorization.k8s.io/cattle-cleanup-role created
time="2024-12-09T21:54:27Z" level=warning msg="failed to reconcile kubelet, error: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?"


Golang-1.10 GOROOT requires manual export on Ubuntu Xenial

What version of Go are you using (go version)?
go version go1.10 linux/amd64
Does this issue reproduce with the latest release?
Yes
What operating system and processor architecture are you using (go env)?
GOARCH="amd64"
GOBIN="/home/holloway/bin"
GOCACHE="/home/holloway/.cache/go-build"
GOEXE=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GOPATH="/home/holloway"
GORACE=""
GOROOT="/usr/lib/go-1.10"
GOTMPDIR=""
GOTOOLDIR="/usr/lib/go-1.10/pkg/tool/linux_amd64"
GCCGO="gccgo"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build607283709=/tmp/go-build -gno-record-gcc-switches"

Ubuntu Xenial (Vanila)
http://ppa.launchpad.net/gophers/archive/ubuntu xenial main

What did you do?
$ sudo add-apt-repository ppa:gophers/archive
$ sudo apt update -y
$ sudo apt install golang-1.10 -y
$ export PATH="/usr/lib/go-1.10/bin:$PATH"
$ vi <a poor go source code> # save it and let go metalinter to perform validation

securekey_test.go|6 col 2 warning| unused struct field could not import testing (cannot find package "testing" in any of: (structcheck)
securekey_test.go|34 col 4 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Errorf (structcheck)
securekey_test.go|38 col 3 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Logf (structcheck)
securekey_test.go|6 col 2 warning| unused variable or constant could not import testing (cannot find package "testing" in any of: (varcheck)
securekey_test.go|41 col 4 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Errorf (structcheck)
securekey_test.go|34 col 4 warning| unused variable or constant invalid operation: t (variable of type *invalid type) has no field or method Errorf (varcheck)
securekey_test.go|66 col 3 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Logf (structcheck)
securekey_test.go|38 col 3 warning| unused variable or constant invalid operation: t (variable of type *invalid type) has no field or method Logf (varcheck)
securekey_test.go|72 col 4 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Errorf (structcheck)
securekey_test.go|41 col 4 warning| unused variable or constant invalid operation: t (variable of type *invalid type) has no field or method Errorf (varcheck)
securekey_test.go|95 col 3 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Logf (structcheck)

$ export GOROOT="/usr/lib/go-1.10"
$ export PATH="$GOROOT/bin:$PATH"
$ vi <the same poor go source code> # save it to let go metalinter to perform validation
# no more error

If possible, provide a recipe for reproducing the error.
A complete runnable program is good.
A link on play.golang.org is best.
Follow all the $ commands in the above
What did you expect to see?
Go 1.10 is setup correctly, with GOROOT properly exported after installation. User only need to set GOPATH, GOBIN etc.
What did you see instead?
Need to set and export GOROOT explicitly to ensure the the standard packages are found.

This is an issue with the debian package itself. Go distributions expect they will be installed in /usr/local/go. For other locations like /usr/lib/go-1.10, you have to set it up yourself.
From the docs - https://golang.org/doc/install

The Go binary distributions assume they will be installed in /usr/local/go (or c:\Go under Windows), but it is possible to install the Go tools to a different location. In this case you must set the GOROOT environment variable to point to the directory in which it was installed.

You should not need to set GOROOT. However this project does not manage the Ubuntu and Debian packages. You will have to raise the issue with them. Sorry.

On 16 May 2018, at 20:23, (Holloway) Chew, Kean Ho<EMAIL_ADDRESS>wrote:
What version of Go are you using (go version)?
go version go1.10 linux/amd64
Does this issue reproduce with the latest release?
Yes
What operating system and processor architecture are you using (go env)?
GOARCH="amd64"
GOBIN="/home/holloway/bin"
GOCACHE="/home/holloway/.cache/go-build"
GOEXE=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GOPATH="/home/holloway"
GORACE=""
GOROOT="/usr/lib/go-1.10"
GOTMPDIR=""
GOTOOLDIR="/usr/lib/go-1.10/pkg/tool/linux_amd64"
GCCGO="gccgo"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build607283709=/tmp/go-build -gno-record-gcc-switches"
Ubuntu Xenial (Vanila)
http://ppa.launchpad.net/gophers/archive/ubuntu xenial main
What did you do?
$ sudo add-apt-repository ppa:gophers/archive
$ sudo apt update -y
$ sudo apt install golang-1.10 -y
$ export PATH="/usr/lib/go-1.10/bin:$PATH"
$ vi  # save it and let go metalinter to perform validation
securekey_test.go|6 col 2 warning| unused struct field could not import testing (cannot find package "testing" in any of: (structcheck)
securekey_test.go|34 col 4 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Errorf (structcheck)
securekey_test.go|38 col 3 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Logf (structcheck)
securekey_test.go|6 col 2 warning| unused variable or constant could not import testing (cannot find package "testing" in any of: (varcheck)
securekey_test.go|41 col 4 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Errorf (structcheck)
securekey_test.go|34 col 4 warning| unused variable or constant invalid operation: t (variable of type *invalid type) has no field or method Errorf (varcheck)
securekey_test.go|66 col 3 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Logf (structcheck)
securekey_test.go|38 col 3 warning| unused variable or constant invalid operation: t (variable of type *invalid type) has no field or method Logf (varcheck)
securekey_test.go|72 col 4 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Errorf (structcheck)
securekey_test.go|41 col 4 warning| unused variable or constant invalid operation: t (variable of type *invalid type) has no field or method Errorf (varcheck)
securekey_test.go|95 col 3 warning| unused struct field invalid operation: t (variable of type *invalid type) has no field or method Logf (structcheck)
$ export GOROOT="/usr/lib/go-1.10"
$ export PATH="$GOROOT/bin:$PATH"
$ vi  # save it to let go metalinter to perform validation
no more error
If possible, provide a recipe for reproducing the error.
A complete runnable program is good.
A link on play.golang.org is best.
Follow all the $ commands in the above
What did you expect to see?
Go 1.10 is setup correctly, with GOROOT properly exported after installation. User only need to set GOPATH, GOBIN etc.
What did you see instead?
Need to set and export GOROOT explicitly to ensure the the standard packages are found.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

@davecheney, noted. Appreciate if this ticket to be reopened until I've transfer the ticket to launchpad please?
I'll close the ticket once the transfer is completed. NOTE: I'm not the only person facing the issue.

After working with Michael Hudson-Doyle, the ppa maintainer. We found that this issue is completely not related to the deb package.

the metalinter issue was caused by the metalinter package itself, and it requires https://github.com/alecthomas/gometalinter/commit/0725fc6d498fd2e3b633d24256604c2fbe161bbc which was committed 11 days ago from this post. Updating the metalinter package with that commit will solve the issue.

Unknown issue with go get -u. I'm no longer be able to reproduce the issue with go get update after performing a mass package update go get -u $GOPATH/src/..., including the issue above.

Since the guide in https://github.com/golang/go/wiki/Ubuntu only spells how to install but not on how to update, I'll list the notes here in case any ubuntu user wants to update their golang in the future.
$ sudo apt remove golang1.X # old version
$ sudo apt update -y
$ sudo apt install golang1.Y # new version
$ export PATH="/usr/lib/golang-1.Y/bin:$PATH"  # to get go and gofmt into your bin list
$ export GOROOT="/usr/lib/golang-1.Y" # temporarily for mass update.
$ go get -u "$GOPATH/src/..." # update all packages

This should prevent any future metalinter or linter issue that cause this problem at the first place.
Restart your terminal without the export GOROOT. Your go should be fine.

@davecheney, the export listed here is meant for problem No. 2, and for other 3rd party packages carrying the same issue like metalinter did (until they fix the problem).
I'm currently using go without needing to export GOROOT after the mass update, AFAIK, from deb packaging standpoint, the go package is installed correctly with the custom path. I agree to you, that you don't need to export GOROOT explicitly.
However, I disagree not to export GOROOT temporarily before the mass updates because that's assuming all 3rd party tool packages are not repeating what metalinter did.

I wonder if you have 2 different versions of Go and a mismatch between GOPATH and GOROOT.
The report should mention the output of the following commands before and after installing golang-1.10:
go env GOROOT
which go


[Bug]: Release downpin on SI following next neo fixes

What happened?
Follow up from #509
Steps to Reproduce
Check logs

Traceback
No response
Operating System
Windows
Python Executable
Conda
Python Version
3.7
Package Versions
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct
[X] Have you ensured this bug was not already reported?

So, this should be address by https://github.com/catalystneuro/neuroconv/pull/516. Closing it here.


Introduction

My Introduction
Haii, nice to meet ya'll~.*
Name
Nasséra Grampon
Class
Visual Interface Design 2 – (VID 2)
About me
I am (pretty) good at creating visual designs with programs like Photoshop, Sketch, InDesign and Illustrator. It's been a long time since I created something with coding, so I probably forgot the most stuff.
Currently I'm also creating a digital comic in my free time when I'm not working on school assignments 😄
Might publish it online too if it's finished 😸  .
Goals
My goals are world domination laughs evil lol, nah just kidding.
I am willing to know more about HTML and CSS since I'm always curious to try new things.

Learn more about HTML and CSS.
Learn about CSS animations
Maybe a little bit of JavaScript too(?)

But my ultimate goal is to understand this powerful (code) language more so I could create my own prototypes into a working product!
Skill level
At HTML/CSS I would consider myself between a beginner and intermediate.
Since I don't code everyday it always brings me back to square one. 😅
But... I do know how to read and write the code and can understand it a bit as well.
GitHub username
https://github.com/DashingNass
GitHub repository
https://github.com/DashingNass/web-animations

🎉 Thanks Nasséra!


Does Not Past Test but my code returns matches the returns in the test

Challenge Where art thou has an issue.
User Agent is: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.110 Safari/537.36.
Please describe how to reproduce this issue, and include links to screenshots if possible.
My code:
function where(collection, source) {
  var arr = [];
  var result = [];
  // What's in a name?
  for(var i = 0; i < collection.length; i++){
    var keys = Object.keys(source);
    var include = true;
    for(var j = 0; j < keys.length; j++){
      if(collection[i][keys[j]] !== source[keys[j]]){
     include = false;
        break;
      }
    }
    if(include){
        result.push(collection[i]);
      }
    }
 return result;
}

where([{ "a": 1 }, { "a": 1 }, { "a": 1, "b": 2 }], { "a": 1 });

@asaki444 We have recently been updating certain function names and the change is slowly propagating. Change your function where to whereAreYou and your code should work. If you notice this inconsistency in the future, you can click on the "Reset" button and it should pre-populate the editor with the correct code. Happy coding!


Red og

Oh

@ReelLion Hi, could you explain a bit more what you are trying to achieve? I will close this PR for now.


v0.1.9

Current dependencies on/for this PR:

main

PR #76   👈

This stack of pull requests is managed by Graphite.


npm ERR! 504 Gateway Time-out: async-validator@https://registry.npmjs.org/async-validator/-/async-validator-1.8.2.tgz

Receiving this error when trying to install via NPM

For yarn registry (https://registry.yarnpkg.com/async-validator/-/async-validator-1.8.2.tgz) it is the same...

It's work correct, now. @marioaldayuz you can close issue.

possibly related issue on npm:
404 Not Found: async-validator@https://registry.npmjs.org/async-validator/-/async-validator-1.8.2.tgz

@thatneat  I encounter the same issue as you did, did you figure out the reason?

@thatneat  I try to use a Chinese mirror of npm, then use cnpm to install again, and it works successfully. I guess the central npm module store may have some bugs.
the link to refer : https://npm.taobao.org/
just need two step :

install cnpm as a module :  npm install -g cnpm --registry=https://registry.npm.taobao.org
use cnpm to install modules : cnpm install [module_name]

Fixed

Thanks!

I'd like to see this issue reopened.
We have a workaround, but npm i async-validator still doesn't work.

The problem has been fixed:
https://github.com/npm/registry/issues/329#issuecomment-392289993

solved, close


Add www/css/ionic.app.* to .gitignore

ionic start myproject blank --sass sets up a gulp workflow to automatically generate css files (www/css/ionic.app.css and www/css/ionic.app.min.css) from a source sass file (scss/ionic.app.scss). It also includes a .gitignore file with various sensible defaults.
.gitignore could include www/css/ionic.app.* (or perhaps rather: name both files explicitly), since it is generally a more useful workflow to track changes in the .scss file and let the other files follow implicitly from there, than to track all three files (redundant, unnecessarily involving a build each time, slightly confusing as to which files you're supposed to edit).

@tomsun - I agree. The same could be said for the platforms and plugins folders, since they are (mostly) generated as well.
This feels very much like a preference thing - some prefer to check in everything, and some are picky.
Let me talk to the team about this and see what the pulse is.


Structured object view

Create a new type of SpaceView that views our object hiearchy in a terse, pretty-way:
object:
  field: 32
  name: "Peter"
  image: [miniature image here]
  child:
    more: true
    stuff: [tensor]

etc.
It's a mostly-text snapshot of all your data at the current time, with links to each object and some small inline previews of images, colors, etc.
This is similar to what we currently show in the selection panel, but should be recursive, and have its dedicated view.
As you scroll the time, you would see the field values change.

Could we make this easier by piggy-backing on our markdown support? That already has images (for previews), tables, link to entities, etc.

Is this superseded by the dataframe view?

I think so, yes.


Train and eval model step by step

Could you please give the guidelines to train and eval the model step by step?

I got your update. Thank you so much!

^_^


Polybar displays blank bar on dwm

Describe the issue
ISSUE
On dwm, polybar is able to create and dock bars to the top/bottom of the screen, but the bars are blank.
Expected behavior:
polybar should be able to write information to the bars.
Actual behavior:
the bars are blank.
Was it working before?
Yes, the bar config, although very messy, worked nicely in i3. Changing to dwm started this problem
To Reproduce
A minimal but complete config with which the problem occurs:
the config(s) are rather long, so I will leave a link here instead:
https://github.com/kiedtl/dotfiles/tree/master/.config/polybar
Polybar Log
Post everything polybar outputs to the terminal when you run it and the issue occurs below
$ polybar top -c ./config-top.ini -l trace >log 2>&1
$ cat ./log
polybar|info:  Loading config: /home/kiedtl/.config/polybar/config-top.ini
polybar|trace: config: Including file "/home/kiedtl/.config/polybar/colors.ini"
polybar|trace: config: Including file "/home/kiedtl/.config/polybar/modules.ini"
polybar|trace: config: Including file "/home/kiedtl/.config/polybar/user_modules.ini"
polybar|trace: config: Including file "/home/kiedtl/.config/polybar/bars.ini"
polybar|trace: config: Current bar section: [bar/top]
polybar|warn:  No monitor specified, using "default"
polybar|info:  Loaded monitor default (1920x1080+0+0)
polybar|warn:  X resource "color0" not found, using defined fallback value "#222"
polybar|warn:  X resource "color7" not found, using defined fallback value "#222"
polybar|warn:  X resource "color6" not found, using defined fallback value "#222"
polybar|warn:  X resource "color6" not found, using defined fallback value "#222"
polybar|info:  Bar geometry: 1920x22+0+0; Borders: 0,0,2,0
polybar|trace: bar: Attach X event sink
polybar|trace: bar: Attach signal receiver
polybar|trace: controller: Install signal handler
polybar|trace: controller: Setup user-defined modules
polybar|warn:  X resource "color6" not found, using defined fallback value "#222"
polybar|warn:  X resource "color6" not found, using defined fallback value "#222"
polybar|warn:  X resource "color6" not found, using defined fallback value "#222"
polybar|trace: module/menu: Creating menu level 0
polybar|trace: module/menu: Creating menu level item 0
polybar|trace: module/menu: Creating menu level item 1
polybar|trace: module/menu: Creating menu level item 2
polybar|trace: module/menu: Creating menu level item 3
sh: 1: i3: not found
polybar|trace: module/i3: Deconstructing
polybar|error: Disabling module "i3" (reason: Could not find socket: <empty>)
polybar|trace: module/workspaces: Deconstructing
polybar|error: Disabling module "workspaces" (reason: The WM does not support _NET_CURRENT_DESKTOP, aborting...)
polybar|warn:  The config parameter `module/keyboard.label-indicator` is deprecated, use `module/keyboard.label-indicator-on` instead.
polybar|warn:  X resource "color6" not found, using defined fallback value "#222"
polybar|trace: module/battery: Deconstructing
polybar|error: Disabling module "battery" (reason: No suitable way to get current charge state)
polybar|trace: module/alsa: Deconstructing
polybar|error: Disabling module "alsa" (reason: Cannot find simple element)
polybar|warn:  X resource "color6" not found, using defined fallback value "#222"
polybar|info:  Starting application
polybar|trace: controller: Main thread id = 1
polybar|info:  Starting module/menu
polybar|info:  Starting module/title
polybar|info:  Starting module/window_switch
polybar|info:  Starting module/keyboard
polybar|info:  Starting module/checknetwork
polybar|info:  Starting module/date
polybar|info:  Starting module/sysmenu
polybar|info:  Entering event loop (thread-id=1)
polybar|trace: module/window_switch: Thread id = 2
polybar|trace: module/title: Thread id = 3
polybar|trace: module/keyboard: Thread id = 4
polybar|info:  module/checknetwork: Invoking shell command: "~/.config/polybar/scripts/check-network"
polybar|trace: module/menu: Thread id = 5
polybar|trace: module/date: Thread id = 6
polybar|info:  Eventqueue worker (thread-id=8)
polybar|trace: bar: Create renderer
polybar|trace: renderer: Get TrueColor visual
polybar|trace: renderer: Allocate colormap
polybar|trace: module/sysmenu: Thread id = 7
polybar|trace: renderer: Allocate output window
polybar|trace: renderer: Allocate window pixmaps
polybar|trace: renderer: Allocate graphic contexts
polybar|trace: renderer: Allocate alignment blocks
polybar|trace: renderer: Allocate cairo components
polybar|trace: renderer: Load fonts
polybar|info:  Configured DPI = 96x96
polybar|info:  Loaded font "xos4 Terminus:size=12" (name=Nimbus Sans L, offset=2, file=/usr/share/fonts/Type1/n019003l.pfb)
polybar|info:  Loaded font "Siji:size=12" (name=Siji, offset=1, file=/usr/share/fonts/misc/siji.pcf)
polybar|info:  Loaded font "xos4 Terminus:size=12" (name=Nimbus Sans L, offset=2, file=/usr/share/fonts/Type1/n019003l.pfb)
polybar|trace: Activate root background manager
polybar|trace: background_manager: Finding root visual
polybar|trace: background_manager: Got root visual with depth 16
polybar|trace: background_manager: Allocating pixmap
polybar|trace: background_manager: Allocating graphics context
polybar|trace: background_manager: Allocating cairo surface
polybar|trace: background_manager: Fetching pixmap
polybar|trace: background_manager: root pixmap (8388609:16) 1920x1080+0+0
polybar|trace: background_manager: Copying from root pixmap (8388609:16) 1920x22+0+0
polybar|info:  Bar window: 0x0600001
polybar|trace: bar: Reconfigure window
polybar|trace: bar: Set window WM_NAME
polybar|trace: bar: Set window _NET_WM_WINDOW_TYPE
polybar|trace: bar: Set window _NET_WM_STATE
polybar|trace: bar: Set window _NET_WM_DESKTOP
polybar|trace: bar: Set window _NET_WM_PID
polybar|trace: bar: Map window
polybar|trace: background_manager: Fetching pixmap
polybar|trace: bar: Received expose event
polybar|trace: background_manager: root pixmap (8388609:16) 1920x1080+0+0
polybar|trace: background_manager: Copying from root pixmap (8388609:16) 1920x22+0+0
polybar|trace: bar: Draw empty bar
polybar|trace: bar: Setup tray manager
polybar|info:  module/menu: Rebuilding cache
polybar|info:  module/title: Rebuilding cache
polybar|info:  module/window_switch: Rebuilding cache
polybar|info:  module/keyboard: Rebuilding cache
polybar|info:  module/checknetwork: Rebuilding cache
polybar|info:  module/date: Rebuilding cache
polybar|info:  module/sysmenu: Rebuilding cache
polybar|trace: bar: Force update
polybar|info:  Redrawing bar window
polybar|trace: renderer: flush(1 geom=58x20+0+0, falloff=0)
polybar|trace: renderer: flush(3 geom=225x20+1695+0, falloff=0)
polybar|info:  module/checknetwork: Rebuilding cache
polybar|info:  Redrawing bar window
polybar|warn:  Dropping unmatched character  (U+e9ff)
polybar|trace: renderer: flush(1 geom=58x20+0+0, falloff=0)
polybar|trace: renderer: flush(3 geom=353x20+1567+0, falloff=0)
polybar|warn:  Termination signal received, shutting down...
polybar|trace: controller: Uninstall sighandler
polybar|trace: controller: Detach signal receiver
polybar|trace: controller: Stop modules
polybar|info:  module/menu: Stopping
polybar|trace: module/menu: Release sleep lock
polybar|trace: module/menu: Deconstructing
polybar|info:  Deconstruction of module/menu took 0 ms.
polybar|info:  module/title: Stopping
polybar|trace: module/title: Release sleep lock
polybar|trace: module/title: Deconstructing
polybar|info:  Deconstruction of module/title took 0 ms.
polybar|info:  module/window_switch: Stopping
polybar|trace: module/window_switch: Release sleep lock
polybar|trace: module/window_switch: Deconstructing
polybar|info:  Deconstruction of module/window_switch took 0 ms.
polybar|info:  module/keyboard: Stopping
polybar|trace: module/keyboard: Release sleep lock
polybar|trace: module/keyboard: Deconstructing
polybar|info:  Deconstruction of module/keyboard took 0 ms.
polybar|trace: module/checknetwork: Release sleep lock
polybar|trace: command: Sending SIGTERM to running child process (480)
polybar|trace: command: Waiting for pid 480 to finish...
polybar|trace: command: killed by signal 15
polybar|info:  module/checknetwork: Stopping
polybar|trace: module/checknetwork: Release sleep lock
polybar|trace: module/checknetwork: Deconstructing
polybar|info:  Deconstruction of module/checknetwork took 0 ms.
polybar|info:  module/date: Stopping
polybar|trace: module/date: Release sleep lock
polybar|trace: module/date: Deconstructing
polybar|info:  Deconstruction of module/date took 0 ms.
polybar|info:  module/sysmenu: Stopping
polybar|trace: module/sysmenu: Release sleep lock
polybar|trace: module/sysmenu: Deconstructing
polybar|info:  Deconstruction of module/sysmenu took 0 ms.
polybar|trace: controller: Joining threads
polybar|info:  Waiting for spawned processes to end
polybar|info:  Reached end of application...

Screenshots
If applicable, add screenshots to help explain your problem.

Environment:

WM:
modified version of dwm, see https://github.com/kiedtl/suckless
Distro:
Void Linux (musl, armv6)
Output of polybar -vvv:

polybar 3.4.0

Features: +alsa +curl +i3 +mpd +network(wireless-tools) +pulseaudio +xkeyboard

X extensions: +randr (+monitors) +composite +xkb +xrm +xcursor

Build type: Release
Compiler: /builddir/.xbps-polybar/wrappers/arm-linux-musleabihf-c++
Compiler flags: -fstack-clash-protection -D_FORTIFY_SOURCE=2 -O2 -pipe -march=armv6 -mfpu=vfp -mfloat-abi=hard -Wno-error=deprecated-declarations -D_LINUX_IF_ETHER_H -g -I/usr/arm-linux-musleabihf/usr/include -Wall -Wextra -Wpedantic -O3 -DNDEBUG
Linker flags: -Wl,-z,relro -Wl,-z,now -Wl,--as-needed    -L/usr/arm-linux-musleabihf/usr/lib

polybar|warn:  X resource "color0" not found, using defined fallback value "#222"
polybar|warn:  X resource "color7" not found, using defined fallback value "#222"
polybar|warn:  X resource "color6" not found, using defined fallback value "#222"
polybar|warn:  X resource "color6" not found, using defined fallback value "#222"

All your colors have the same fallback value. The bar isn't blank, it just black text on a black background.

Oh man... I feel so dumb right now, why didn't I figure this out earlier I wonder lol xD


Class variables

The following input fails for all languages
class A:
  B = 'FOO'

if __name__ == '__main__':
	assert A.B == 'FOO'
	print('OK')

The following Rust is generated
struct A {
B: ST0,
}

impl A {
let B: &str = "FOO";
}
fn main()  {
assert!(A::B == "FOO");
println!("{}","OK");
}

When we know B is not mutated, it could be a const in Rust.  mutable class variables require a shadow struct with a module level global/static instance, and getter/setters in the instance struct.

dataclasses ClassVar also does not work, but this might be a good approach to introducing class variables for targets which support that.

The test case passes for rust as of today.
Changes needed for cpp: https://paste.ubuntu.com/p/vvJD4yRKNp/


Convert remaining identifier javascript code to typescript

Convert remaining identifier javascript code to typescript and add all possible type notations as installation packages.

@soun059 I convertest this to a draft.


Problem with the commissioning in the Google Eco-System

Hello All,
I have a problem with the commissioning process in the Google Home Mobile SDK for Android. I want to commission our device with our Custom App in the Google Eco-System. So that I can see and use the device in our App and in the Google Home App. But I never see our device in the Google Home App.
I tried two ways:
I used the default CommissioningService of the Home Mobile SDK. The device commissioning was succeed and I can control it with our Custom App but not in the GHA.
I overwritten the CommissioningService like the Google Home Sample App for Matter. The device commissioning was succeed and I can control it with our Custom App but not in the GHA.
I think, I have a understanding misstake about the commissioning implementation of the Google Home Mobile SDK.
Can someone explain what I do wrong?

Note that the commissioning API commissions first to the local Android fabric, and then to the app's own fabric. It does not commission to the Google ecosystem fabric. Note that there are future plans for APIs that leverage the fact that some devices are on the local Android fabric.

Thanks for the explanation. Is there a way to add devices to the Google Ecosystem Fabric via our own app? We want that the Google Home App is the base App and our app is only for manufacturer specific functions.

You may want to check https://developers.home.google.com/io#upcoming-preview-programs.

@pierredelisle Hello,
Two times I tried to register for this program but I got always nothing response. I heard that Google is going to fix this. Is there a date when it is released?


fixed credentials in tests

Coverage increased (+0.7%) to 71.397% when pulling 3db1f45747b518e14a3758656b2674d7c4e8f46d on fix-config into 66048fac1c030c6ac555f13d1890121eb7a938e4 on master.

LGTM.


Remove allowComplexConstraintInference in inferTypes

For #27244 (technically Fixes but I want to try it quick before applying that label)
This TODO was added many many years ago but was never revisited; the tests pass with this removed but I'm curious what the extended test suites say.

@typescript-bot test this
@typescript-bot test top100
@typescript-bot user test this
@typescript-bot run dt
@typescript-bot perf test this

@typescript-bot test this
@typescript-bot test top100
@typescript-bot user test this
@typescript-bot run dt
@typescript-bot perf test this

Seems like everything passes? Even RWC? Probably not a good idea to stick post-beta though.

Merging, since it's early 5.3 and I feel safer doing so.


Broken link in Coding Compression chapter

In "The Whole Story" section, the link to a brief explanation for huffman coding no longer works (http://www.cimt.org.uk/siteinfo/plymouth404.htm)
http://csfieldguide.org.nz/en/chapters/coding-compression.html#the-whole-story

Fixed in 62ac616


rpiboot for eeprom upgrade doesn't work

Hi.
It is not clear to me how to use the TOFU board for upgrading and or configuring the CM4 eeprom.
When attaching Tofu-USB-C to my computer, rpiboot won't connect to the TOFU board.
Note:
I do still have a NVME SSD attached. The TOFU board still seems to boot from NVME SSD.
From what I understand that shouldn't happen if powered from USB-C and connected to a USB host.
What am I doing wrong here?
Please add a note to your description how to run the eeprom upgrade or config change, in case I missed it.

This was also confusing for me. What I eventually realized is you need to be holding the small nRPIBOOT button when you power it on. This will allow it to connect to a computer for flashing.
Hopefully that helps you @klslz or anyone else who stumbles across this.


What is the need to redirect to harvest creds?

I don't quite understand how this example shows that http-equiv enables credential harvesting. Even without using redirection, you can simply send a form that is styled like the iCloud login in an email to harvest credentials. Sure, the redirection adds a bit of a lag which improves the believability but thats about it from what I can tell. Please correct me if I'm wrong or if anyone can think of other malicious use cases when allowing http-equiv in the Mail app. Sorry I posted this as an issue but I wasn't sure where to have this conversation..

Hi Jeff,
that is actually a valid point. It is possible to send directly the contents of index.php file and get very similar results - the form is displayed and functional.
However, you lose certain features by hardcoding the form directly into the e-mail:

When you use this http-equiv method, the remote page containing login form gets loaded only on vulnerable iOS device. It wouldn't make much sense if it asked for Apple ID credentials with iOS-styled dialog box when opened in Outlook or Gmail on the desktop, right? Because the redirect meta tag gets ignored by other mail clients, it will look like a regular e-mail message.
You cannot use cookies in regular HTML e-mail, therefore the login form would pop-up every time a test subject opens the message
Once you send out an e-mail with hardcoded login form, you cannot change your mind later. If you use this redirect method, you can replace the malicious page containing the login form with simple page containing just the text of the original e-mail (e.g. after you've collected the login credentials).

Also, this proof of concept was meant only to demonstrate the redirect vulnerability, not to showcase credentials harvesting. The vulnerability can be used for anything that requires HTML tags not supported by Mail.app.

All of those are good points, mainly #1 and the last part about being able to use other HTML tags that aren't supported. Good find and I appreciate the quick response.

How should I run the 6 files?

There are no detailed steps for the operation

jansoucek ，can U send me a Operation steps？my email<EMAIL_ADDRESS>

Hi everybody, im working in the perfect cloning of actual iCloud index login page, in a few days i sharing to you... please be patients. Nice Project, now its running on my server.

There is a reason why the iCloud login dialog doesn't already look identical to the real thing. The reason is that this repository is not meant to be ready-to-use kit to scam people. It is a proof-of-concept, with the dialog styled just similarly enough to the real thing to get the attention it needed to get the issue fixed. Please do not create pull requests with enhancements to the dialog's looks.


ArgumentError - invalid byte sequence in UTF-8

app_1      | 2019-03-29 15:55:38 - ArgumentError - invalid byte sequence in UTF-8:
app_1      |    /usr/local/bundle/gems/sinatra-param-1.6.0/lib/sinatra/param.rb:122:in `==='
app_1      |    /usr/local/bundle/gems/sinatra-param-1.6.0/lib/sinatra/param.rb:122:in `block in validate!'
app_1      |    /usr/local/bundle/gems/sinatra-param-1.6.0/lib/sinatra/param.rb:115:in `each'
app_1      |    /usr/local/bundle/gems/sinatra-param-1.6.0/lib/sinatra/param.rb:115:in `validate!'
app_1      |    /usr/local/bundle/gems/sinatra-param-1.6.0/lib/sinatra/param.rb:23:in `param'
app_1      |    /service/lib/routes/avatar.rb:19:in `block in <class:Application>'

The line in my code is:
param :email, String, blank: false
The request made to the server has a param of:
<EMAIL_ADDRESS>

%B3 by itself is an invalid UTF-8 byte sequence. You can verify this by entering the string into an HTML / percent-encoding decoder; the result is invalid (�).
It looks like the the rescue clause where we try to encode the invalid value to generate the exception is itself raising ArgumentError. I'll look into how we might do this more safely to handle invalid string values.


Move profile into header

Add expandable section that shows the profile in the header bar

Profile has now its own page.


Fix unused variable warnings

@Rombur Do you not get any boost warnings?

No I don't but I ran without cuda so no nvcc_wrapper


postinstall is broken on Windows

Error (this was when running npm i -g tweasel-cli):
npm ERR! code 1
npm ERR! path C:\Users\root\AppData\Roaming\npm\node_modules\tweasel-cli\node_modules\appstraction
npm ERR! command failed
npm ERR! command C:\Windows\system32\cmd.exe /d /s /c node scripts/postinstall.js; andromatic-install -p platform-tools 'build-tools;33.0.2'
npm ERR! node:internal/modules/cjs/loader:1078
npm ERR!   throw err;
npm ERR!   ^
npm ERR!
npm ERR! Error: Cannot find module 'C:\Users\root\AppData\Roaming\npm\node_modules\tweasel-cli\node_modules\appstraction\scripts\postinstall.js;'
npm ERR!     at Module._resolveFilename (node:internal/modules/cjs/loader:1075:15)
npm ERR!     at Module._load (node:internal/modules/cjs/loader:920:27)
npm ERR!     at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)
npm ERR!     at node:internal/main/run_main_module:23:47 {
npm ERR!   code: 'MODULE_NOT_FOUND',
npm ERR!   requireStack: []
npm ERR! }
npm ERR!
npm ERR! Node.js v18.15.0

Full debug log: 2023-07-12T21_42_03_073Z-debug-0.log

As a workaround you can install like this: npm i appstraction --ignore-scripts.
This will skip the postinstall script and not preinstall the dependencies. But that isn't much of a problem. They are installed on demand anyway.

It seems like the error is caused by the semicolon being considered part of the path in Powershell. If I separate the semicolon from the path with a space, the postinstall script runs.

Aha, apparently npm on Windows doesn’t understand the semicolon at all and treats the second command as arguments of the first. Here is a minimal version to reproduce that:
{
  "name": "test",
  "version": "1.0.0",
  "main": "index.js",
  "scripts": {
    "postinstall": "echo 'first'; echo 'second'"
  }
}

On Windows 10 PowerShell, we get:
PS C:\Users\user\Documents\test> npm run postinstall

><EMAIL_ADDRESS>postinstall
> echo 'first'; echo 'second'

'first'; echo 'second'

While on a Fedora zsh this runs like expected:
❯ npm run postinstall

><EMAIL_ADDRESS>postinstall
> echo 'first'; echo 'second'

first
second

It should be noted that this is not an issue with PowerShell, as this runs it just fine:
PS C:\Users\user\Documents\test> echo 'first'; echo 'second'
first
second

The problem is that the normal Windows cmd does not recognize ; a a special character. Windows uses & for that. && should work on both machines, though, so maybe let’s use that.

The examples for Android seem to run fine on Windows, after I fixed the install.


Make autojump work on macOS

macOS doesn't come with tac, and the snippet is copied from fzfz, so should be safe to merge.
https://github.com/andrewferrier/fzf-z/blob/4395e87dd43c4404699bb655a0e331abd3403b13/fzfz#L31-L35
https://github.com/andrewferrier/fzf-z/blob/4395e87dd43c4404699bb655a0e331abd3403b13/fzfz#L76

Good call, this makes sense.

Thanks!


Is there a guide to implement VueJS client?

I want to use this package in my Laravel-Vue SPA.
But I cannot find the VueJS client package for your package.
Can you discuss about this?

Hello,
I have a work-in progress javascript client coded as a part of another unfinished application, but the client is very basic and lacking some more advanced features (file uploads, etc).
I've uploaded the unfinished client to the nodejs client repository: https://github.com/kbs1/encrypted-api-client-nodejs - maybe you will be able to use some of the code.
If you need, I can also publish the unfinished application that used the client, but it's use should be straight-forward enough.
Please keep in mind that this project is no longer maintained, however any pull requests are apprecitated.
Regards,
kbs1

Hello,
I have a work-in progress javascript client coded as a part of another unfinished application, but the client is very basic and lacking some more advanced features (file uploads, etc).
I've uploaded the unfinished client to the nodejs client repository: https://github.com/kbs1/encrypted-api-client-nodejs - maybe you will be able to use some of the code.
If you need, I can also publish the unfinished application that used the client, but it's use should be straight-forward enough.
Please keep in mind that this project is no longer maintained, however any pull requests are apprecitated.
Regards,
kbs1


Selection of activation function can lead to AssertionError: The SHAP explanations do not sum up to the model's output!

Issue Description
AssertionError: The SHAP explanations do not sum up to the model's output! This is either because of a rounding error or because an operator in your computation graph was not fully supported. If the sum difference of %f is significant compared to the scale of your model outputs, please post as a github issue, with a reproducible example so we can debug it. Used framework: pytorch - Max. diff: 0.0220772960322535 - Tolerance: 0.01
And the reason is that the activation function GeLU is used, and the shape package can not recognize it. If I use Tanh or ReLU then this disappear.
Minimal Reproducible Example
import torch, torchvision
from torchvision import datasets, transforms
from torch import nn, optim
from torch.nn import functional as F

import matplotlib.pyplot as plt
import numpy as np
import shap

batch_size = 128
num_epochs = 2
device = torch.device('cpu')

class Net(nn.Module):
    def __init__(self):
        super(Net, self).__init__()

        self.conv_layers = nn.Sequential(
            nn.Conv2d(1, 10, kernel_size=5),
            nn.MaxPool2d(2),
            nn.GeLU(),
            nn.Conv2d(10, 20, kernel_size=5),
            nn.Dropout(),
            nn.MaxPool2d(2),
            nn.GeLU(),
        )
        self.fc_layers = nn.Sequential(
            nn.Linear(320, 50),
            nn.GeLU(),
            nn.Dropout(),
            nn.Linear(50, 10),
            nn.Softmax(dim=1)
        )

    def forward(self, x):
        x = self.conv_layers(x)
        x = x.view(-1, 320)
        x = self.fc_layers(x)
        return x

def train(model, device, train_loader, optimizer, epoch):
    model.train()
    for batch_idx, (data, target) in enumerate(train_loader):
        data, target = data.to(device), target.to(device)
        optimizer.zero_grad()
        output = model(data)
        loss = F.nll_loss(output.log(), target)
        loss.backward()
        optimizer.step()
        if batch_idx % 100 == 0:
            print('Train Epoch: {} [{}/{} ({:.0f}%)]\tLoss: {:.6f}'.format(
                epoch, batch_idx * len(data), len(train_loader.dataset),
                100. * batch_idx / len(train_loader), loss.item()))

def test(model, device, test_loader):
    model.eval()
    test_loss = 0
    correct = 0
    with torch.no_grad():
        for data, target in test_loader:
            data, target = data.to(device), target.to(device)
            output = model(data)
            test_loss += F.nll_loss(output.log(), target).item() # sum up batch loss
            pred = output.max(1, keepdim=True)[1] # get the index of the max log-probability
            correct += pred.eq(target.view_as(pred)).sum().item()

    test_loss /= len(test_loader.dataset)
    print('\nTest set: Average loss: {:.4f}, Accuracy: {}/{} ({:.0f}%)\n'.format(
        test_loss, correct, len(test_loader.dataset),
    100. * correct / len(test_loader.dataset)))

train_loader = torch.utils.data.DataLoader(
    datasets.MNIST('mnist_data', train=True, download=True,
                   transform=transforms.Compose([
                       transforms.ToTensor()
                   ])),
    batch_size=batch_size, shuffle=True)

test_loader = torch.utils.data.DataLoader(
    datasets.MNIST('mnist_data', train=False, transform=transforms.Compose([
                       transforms.ToTensor()
                   ])),
    batch_size=batch_size, shuffle=True)

model = Net().to(device)
optimizer = optim.SGD(model.parameters(), lr=0.01, momentum=0.5)

for epoch in range(1, num_epochs + 1):
    train(model, device, train_loader, optimizer, epoch)
    test(model, device, test_loader)

batch = next(iter(test_loader))
images, _ = batch

background = images[:100]
test_images = images[100:103]
e = shap.DeepExplainer(model, background)
shap_values = e.shap_values(test_images)

Traceback
No response
Expected Behavior
AssertionError: The SHAP explanations do not sum up to the model's output! This is either because of a rounding error or because an operator in your computation graph was not fully supported. If the sum difference of %f is significant compared to the scale of your model outputs, please post as a github issue, with a reproducible example so we can debug it. Used framework: pytorch - Max. diff: 0.0220772960322535 - Tolerance: 0.01
Bug report checklist

[X] I have checked that this issue has not already been reported.
[X] I have confirmed this bug exists on the latest release of shap.
[X] I have confirmed this bug exists on the master branch of shap.
[ ] I'd be interested in making a PR to fix this bug

Installed Versions
Version: 0.45.1

Yes, GeLU is currently not supported


SSL certificate expired

HTML5Test.com depends on http://api.whichbrowser.net/rel/detect.js in order to successfully run.
LetsEncrypt certificate has expired since October 19th, so that file cannot be served and so the HTML5 tests don't run.

As a workaround, you can use https://backup.whichbrowser.net/rel/detect.js.


dapr-bot (assign) is broken

Expected Behavior

When commenting /assign on an issue the author should be assigned to the issue.
Actual Behavior

Errors-out
Steps to Reproduce the Problem

Comment on an issue /assign and observe the action failure.
Example run: https://github.com/dapr/quickstarts/actions/runs/7528942727

/assign

Fixed the issue with PR https://github.com/dapr/quickstarts/pull/985

Closed


Bluetooth: Audio: Shell: Make broadcast source generic

Implement profile-agnostic broadcast source and broadcast stream structs, similar to the unicast stream struct.
The purpose of these are to be able to use the same structs for multiple profiles such as BAP, CAP and TMAP.
Since only the BAP shell implements broadcast support at this moment, the changes are minimal, but makes it easier to implement broadcast support for other profile shells.

Add (void) before memcpy

See https://github.com/zephyrproject-rtos/zephyr/pull/57587#discussion_r1188394154
It is, per our coding guidelines, not something we can enforce, and in fact something that hardly anyone does. I can add it if you still request it, but otherwise it seems that the general consensus is not to do that (anymore).


Quick start

These commands should work once the repo is public.
Gonna just predict there will be a few follow-up PRs to get things working for real.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Eric Dobbs seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


An alternate alternateTextColor should exist for accent colors

Problem description
At the moment it is possible to define a single alternateTextColor in the color palette. This color is used for text rendered on primary color backgrounds as well as secondary color backgrounds. This results in badly readable texts (and not following the spec).
A quick fix would be to split alternateTextColor into two different values, for example primaryTextColor and secondaryTextColor.
A proper fix would be to allow 6 different values, because 3 primary and 3 accent colors are used by material-ui.
Link to minimal working code that reproduces the issue
https://www.webpackbin.com/bins/-Kh7_VZmsyOUCINR6ATr
Versions

Material-UI: 0.17.1
React: 5.4.2
Browser: any

Thanks for the suggestion - the palette has been reworked for the next branch. It's unlikely we'll make these sorts of changes on master at this stage.

We migrated the theme on the next branch. We reimplemented it from the ground-up. While we haven't tested it, I think that the issue is most likely fixed on that branch. Hence, I'm closing it.