Windows Bash - Python 3.5.2 pyodbc "Can't open lib 'ODBC Driver 13 for SQL Server'"

Please use the following bug reporting template to help produce actionable and reproducible issues. Please try to ensure that the reproduction is minimal so that the team can go through more bugs!

A brief description
I have installed all necessary components so I can do "import pyodbc" in python without any errors.
I can execute the same code in Windows Python but I'm getting an error loading the ODBC driver after import pyodbc.

Expected results
No errors executing the code.

Actual results (with terminal output if applicable)
root@MTrinidadLT2:/mnt/c/Users/mtrinidad# python3
Python 3.5.2 (default, Nov 17 2016, 17:05:23)
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.

import pyodbc
cnxn = pyodbc.connect('DRIVER={ODBC Driver 13 for SQL Server};SERVER=mtrinidadlt2\MSSQL2K16A;PORT=1443;DATABASE=sampledb1;UID=sa;PWD=xxxxxx')
Traceback (most recent call last):
File "", line 1, in
pyodbc.Error: ('01000', "[01000] [unixODBC][Driver Manager]Can't open lib 'ODBC Driver 13 for SQL Server' : file not found (0) (SQLDriverConnect)")

Your Windows build number
Windows 10 Pro Insider Preview Build 15007.rs_prerelease.170170-1846

Steps / All commands required to reproduce the error from a brand new installation
After installing pyodbc, open Python3.
Type the following code:
import pyodbc
cnxn = pyodbc.connect('DRIVER={ODBC Driver 13 for SQL Server};SERVER=mtrinidadlt2\MSSQL2K16A;PORT=1443;DATABASE=sampledb1;UID=sa;PWD=xxxxxxx')

Strace of the failing command

cnxn = pyodbc.connect('DRIVER={ODBC Driver 13 for SQL Server};SERVER=mtrinidadlt2\MSSQL2K16A;PORT=1443;DATABASE=sampledb1;UID=sa;PWD=$Adm1n!')
Traceback (most recent call last):
File "", line 1, in
pyodbc.Error: ('01000', "[01000] [unixODBC][Driver Manager]Can't open lib 'ODBC Driver 13 for SQL Server' : file not found (0) (SQLDriverConnect)")

Required packages and commands to install
sudo apt install python3-pip
sudo pip3 install --upgrade pip
sudo pip3 install --upgrade setuptools
sudo pip3 install pylint
sudo apt install unixodbc-dev
sudo apt-get install unixodbc-bin
sudo pip3 install pyodbc

See our contributing instructions for assistance.

Hib@MaximoTrinidad , thanks for the report!  Question:  I notice that you've detailed all of the steps to install unixodbc.  Have you installed the SQL Server ODBC driver for Linux?  If so, could you include the steps that you followed to configure it?  (If not, could you give that a try?)

Hi @aseering,
I went ahead and install the msodbcsql driver. But I'm still getting the same error message.
-- MSSQL ODBC load for Ubuntu:
sudo su
sh -c 'echo "deb [arch=amd64] https://apt-mo.trafficmanager.net/repos/mssql-ubuntu-test/ xenial main" > /etc/apt/sources.list.d/mssqlpreview.list'
sudo apt-key adv --keyserver apt-mo.trafficmanager.net --recv-keys 417A0893
apt-get update
apt-get install msodbcsql
pyodbc.Error: ('01000', "[01000] [unixODBC][Driver Manager]Can't open lib 'ODBC Driver 13 for SQL Server' : file not found (0) (SQLDriverConnect)")
Any other ideas!
:)

@aseering ,
Question... Do I need to have SQL Server installed for pyodbc to work?
:)

Hi @MaximoTrinidad -- no, you don't need to have SQL Server itself installed.  But you do need to install the SQL Server ODBC driver. It looks like the relevant documentation can be found here:
https://msdn.microsoft.com/en-us/library/hh568454(v=sql.110).aspx
Try following the Ubuntu 16.04 instructions.  If you run into trouble, I would suggest trying to follow the instructions in an Ubuntu 16.04 VM.  If it still doesn't work in a VM, then that's not a WSL problem; I'd suggest asking for help in the SQL Server MSDN forums.  (You can try asking for help here too, but people there will know more about SQL Server than I do :-) )
If it does work in a VM but not in WSL, then post back here with the same level of detail as in your post above (but with the steps that work in Ubuntu and not in WSL); that's something that folks here can help with.

Incidentally, if you just want to connect to a SQL Server database and you don't need ODBC in particular, I would just use pymssql.  That's Python' standard DBAPI driver for SQL Server.  You're trying to access SQL Server through Python's ODBC compatibility layer, which I personally find to be slower and harder to set up.  But if your app requires ODBC, then ODBC should certainly still work.

Interesting!  Forgive me for missing some information about my environment.
I already got the Python PYODCB working in both Windows Python (both physical and VM) as well as Ubuntu 16.04 physical system.
So, in this scenario, I got WSL on a physical machine with the latest Windows 10 build 15007 (and I did rebuild my WSL).  I did the same steps to make pyodbc work on my other installations: Ubuntu and Windows which works great.
My problem is with WSL.  I thought that if I can do an "import pyodbc" in python3 then I was good to go. But with WSL, this is not the case.  I just need someone to duplicate my steps and verify if I'm missing something.
I'm interested to make WSL work so I can demo using Python in a cross-platform environments.
By the way, THANKS for telling about "pymssql". I was going the "pyodbc" way because of the samples provided by Microsoft for using Python for SQL Server vNext.
I appreciate the help!
:)

Regarding import pyodbc -- that is actually not sufficient even on regular Linux.  I can confirm that your steps above do not work on a stock Ubuntu Linux system without installing additional packages and/or performing additional setup.
ODBC is not a SQL Server library.  It is a generic wrapper library that can connect to many different databases (Oracle, MySQL, PostgreSQL, etc) but only if their specific drivers have been separately installed and configured.  So you do always need to separately configure an ODBC driver for the specific database that you plan to use.
This is actually true on all platforms -- Windows, WSL, Linux, Mac, Solaris, etc.  It's a basic property of how ODBC works.  But if you, for example, install some SQL Server-related packages on your machine, one of those packages might do that configuration for you.

Awesome! And, I appreciate telling me about 'pymssql'.
It turned out, as of now I got 'pyodbc' working on Ubuntu 16.04.1 and Windows 10 with Python 3.5.2 but not on WSL.
Now, I got install 'pymssql'. It's working in Windows 10 and WSL like a charm with the only issue that I can't connect different SQL instances on the same machine (I already posted an issue on 'pymssql' on it).
So, I'm thinking using 'pymssql' for my presentation while I figured out what's wrong with 'pyodbc' in WSL.
Thanks for all the explanation!
:)

Very disappointing!!  They closed my ticket without a quick answer on how to solved my 'pymssql' how to connected SQL Server instances ("computername\instance99") issue.  And, my organization doesn't allow me to access Google forums.  So, I got to wait until I get home to find a quick answer or it may be none.
@aseering, have you use 'pymssql' in a multiple SQL instance (on the same system) scenario. I just need to know how to build the string correctly.
About, the current issue with 'pyodbc' in WSL, I have a VM where I'm resetting bash in order the duplicate the steps and verify if I will get the same errors.
Thanks again!

Hi @MaximoTrinidad -- regarding pymssql -- I haven't used that configuration before, but have you looked through their documentation?  One of their examples looks like it describes what you're trying to do:
http://pymssql.org/en/latest/pymssql_examples.html#connecting-using-windows-authentication
One thought:  Are you using a raw string and/or escaping the backslash properly?

@aseering, In there samples, there are example of an instance server ("computername\instance99"), just simply "computername" which works.  And, Yes! I'm using raw string "computername\instance1".

@aseering,
As I venture thru trial-and-error.  I was finally able to use 'pyodbc' in WSL by installing the 'msodbcsql' using 'sudo su':
sudo su
sudo apt install msodbc
At the same time, I realized (and have to accept) that, from WSL (or Linux) environment, I can only query to a local single instance SQL Server and not there are multiple instances.
Windows WSL (or Linux Ubuntu distro) to Windows - using Python either "import pyodbc" or "import pymsql":
Server = 'computername' - Good
Server = 'computername\instance' - not possible (will fail).
But, in Windows to Windows,  in Python you can query multiple SQL instances:
Server = 'computername' - Good
Server = 'comutername\instance99' - Good
So, finally made pyodbc to work and connect to a SQL Server local instance. And, this is enough for me for my upcoming presentation and blog post.
Once again, Thanks @aseering!
This issues can be closed for now.
See images:

@aseering

[pymssql is] Python's standard DBAPI driver for SQL Server.

Not really. As far as I know, the Python Software Foundation has never officially endorsed pymssql.
However, pyodbc is officially supported by Microsoft.
As for this issue, the saga continues here.

Re:

Can't open lib X: file not found

Solution is to create odbcinst.ini and define path to your SQL ODBC driver.
Follow-up: https://github.com/Microsoft/homebrew-mssql-preview/issues/4


Typo in readthedocs (integration)

Typo in step 6 of Steps to run here: https://panpipes-pipelines.readthedocs.io/en/latest/workflows/integration.html
Change panpipes integration make merge_batch_correction to panpipes integration make merge_integration

@JHYSiu  thaks for point out, fixed by this PRhttps://github.com/DendrouLab/panpipes/pull/88


does not recognize .jfif (JPEG) files

Describe the bug
We noticed that when we put .jfif(JPEG Interchange) files in the media folder, they do not show up in the main OnlyM window .
If we rename each of the file extensions to .jpg they then show up in the media window.
This is a quick fix but it takes time and above average computing skills.
To Reproduce
Steps to reproduce the behavior:

Download a JFIF file. We noticed that these are typically exported from Google Slides or PowerPoint Online presentations.
Try to load them into OnlyM
Rename the extension to .jpg

Expected behavior
It would be nice if this file type were supported and would be recognized by OnlyM without modification.
Screenshots
Desktop (please complete the following information):

Windows 10 b1809
OnlyM 15.0.23

@onefellsloop Thanks. Will be available in next pre-release (today I hope)


Update CI to test newer versions of Node

Right now CI tests Node 12 and Node 14. Node 12 went EOL a year and a half ago, and stopped receiving even security updated two weeks ago. Node 14 went into Maintenance mode six months ago, and stops receiving security updates in less than a year.
My current plan is to update this project's Actions to test Node 16 and 18 instead. Node 16 is active for another five months, and Node 18 has 17 months because it just launched three weeks ago.

BTW NodeJS has a very pleasant graph for tracking release lifespans: https://nodejs.org/en/about/releases/


G502

Added support for the Logitech G502 mouse.
Solves #710 , thanks for the images @Kisco

Thank you very much for the contribution!


Can't get started

I am probably doing something very wrong..
I did this:

I cloned the very simple demo
npm i
npm i --save @kadira/storybook-deployer
Added "deploy-storybook": "storybook-to-ghpages"
npm run deploy-storybook

And got the attached npm-debug.log
npm-debug.pdf

When I use "storybook-to-ghpages" command to publish I had same problem too.
So I looked into story-deployer source code, and found they create a series of git shell command to commit and publish.
I tried to use these cmd to repeat the Error, but every step I had no permission to exec. So the solution is, give your project folder and all of it's files & folders full permission, at least this solved my problem. @bestwestern

To start using storybook-deployer you need to add it as devDependency to a repo with Storybook installed. See readme for details.
@bestwestern Looks like you run it on Windows. At this moment Windows isn't supported because of #11. Going to fix it


Deprecate utilities in favor of ign-utils

🎉 New feature

Closes https://github.com/ignitionrobotics/ign-cmake/issues/171

Summary

Added pragma messages that are printed on compilation to warn users
Removed tests so that we don't get the messages. I wasn't sure how to suppress the message otherwise, and I think that we're fairly confident that the feature works as intended at this point.

Test it

You can restore the test and compile to see the warning, for example:
$ colcon build --cmake-args="-DBUILD_TESTING=true" --packages-select-regex=.*n-cmake
Starting >>> ignition-cmake3
--- stderr: ignition-cmake3
In file included from /home/chapulina/dev_focal/ws_fortress/src/ign-cmake/test/warning/nonvirtual_destructor.cc:20:
/home/chapulina/dev_focal/ws_fortress/src/ign-cmake/include/ignition/utilities/SuppressWarning.hh:23:85: note: #pragma message: ign-cmake (utilities) SuppressWarning is deprecated, use ign-utils
   23 | #pragma message("ign-cmake (utilities) SuppressWarning is deprecated, use ign-utils")
      |                                                                                ^
---
Finished <<< ignition-cmake3 [0.52s]

Checklist

[x] Signed all commits for DCO
[x] Added Removed tests
[ ] Added example and/or tutorial
[x] Updated documentation (as needed)
[x] Updated migration guide (as needed)
[x] codecheck passed (See contributing)
[x] All tests passed (See test coverage)
[x] While waiting for a review on your PR, please help review another open pull request to support the maintainers

Note to maintainers: Remember to use Squash-Merge and edit the commit message to match the pull request summary while retaining Signed-off-by messages.
🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸🔸

the #pragma messages may show up in colcon, but jenkins doesn't seem to recognize them as compiler warnings:

 https://build.osrfoundation.org/job/ignition_rendering-ci-pr_any-ubuntu_auto-amd64/2334/

In file included from /usr/include/ignition/cmake3/ignition/utilities/detail/ExtraTestMacros.hh:21,
                 from /usr/include/ignition/cmake3/ignition/utilities/ExtraTestMacros.hh:21,
                 from /home/jenkins/workspace/ignition_rendering-ci-pr_any-ubuntu_auto-amd64/ign-rendering/src/Heightmap_TEST.cc:22:
/usr/include/ignition/cmake3/ignition/utilities/SuppressWarning.hh:23:85: note: #pragma message: ign-cmake (utilities) SuppressWarning is deprecated, use ign-utils
   23 | #pragma message("ign-cmake (utilities) SuppressWarning is deprecated, use ign-utils")
      |                                                                                ^
In file included from /home/jenkins/workspace/ignition_rendering-ci-pr_any-ubuntu_auto-amd64/ign-rendering/src/Heightmap_TEST.cc:22:
/usr/include/ignition/cmake3/ignition/utilities/ExtraTestMacros.hh:23:85: note: #pragma message: ign-cmake (utilities) ExtraTestMacros is deprecated, use ign-utils
   23 | #pragma message("ign-cmake (utilities) ExtraTestMacros is deprecated, use ign-utils")
      |                                                                                ^


fix(version): update fabric8-stack-analysis-ui to 0.1.15

There were the following issues with your Pull Request

Commit: 0a15639207fe4db0acc671e86d6463e7a2ddd32e
Your subject line is longer than 50 characters

Guidelines are available at https://github.com/fabric8io/fabric8-ui

This message was auto-generated by https://gitcop.com


remove old paredit and slime expressions, use the new melpa emacs packages

Could somebody merge this please?

Merged, thanks!


Quick question about training time and compute

Hello, thanks for your great work. I have a very question about training.
I'm trying to run training and getting an OutOfMemoryError using a (single) 32 GB GPU (V100). What do you use for training? Also, with your compute setup, approximately how long does training take?
Thanks so much!

Hi, thanks for appreciating our work!
For metric fine-tuning, We use 4 NVIDIA A100 GPUs for training our largest model (BEiT-L). Training time on NYU (~25k samples, 5 epochs) on 4 A100s is less than 2 hours.
Relative pre-training on 12 datasets (M12 from the paper) takes around 3-5 days on 8 RTX A6000-like GPUs. This gives us the MiDaS v3.1 models. Please refer to midas repo for more details.

Brilliant, thanks for the quick response. It's great to hear that the training time is quick.
I'll create another issue if I have any more questions, but this is resolved, so I'm closing the issue.


Error with vmss option

I'm getting this error
unrecognized arguments: --enable-vmss
Has --enable-vmss been removed from the aks-preview CLI extension? I used it in the past successfully, but no longer

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 60a7a0a8-97e7-0fda-763c-1a9972f4e9bc
Version Independent ID: 82b46441-43fc-fe48-97e2-0f3fca3d6eab
Content: Preview - Use a Standard SKU load balancer in Azure Kubernetes Service (AKS)
Content Source: articles/aks/load-balancer-standard.md
Service: container-service
GitHub Login: @zr-msft
Microsoft Alias: zarhoads

I have already updated it and re-registered the features
I tried again and same problem

Running locally

Same issue in the Cloud Shell  :(
My shell is reporting azure-cli 2.0.72

hmm looks like something is up with --enable-vmss.
@mlearned @sauryadas any idea on this?

@jluk might know.

Just ran it without --enable-vmss and I got a Standard SKU load balancer but also my cluster was backed with a VMSS
So maybe we've flipped to VMSS being the default ?

@benc-uk you are correct. However, we are re-enabling the --enable-vmss flag and reverting the default swap in order to give customers a notice on our release notes which are going out today. Expect the preview extension defaults to be changed on 9/10.

Sounds much like a case of "interesting" timing on my part!
Thanks for the investigation guys. I guess if --enable-vmss is coming back, there's no change to the docs needed

Yep you're really on the ball with this one - on 9/10 this SLB doc will be updated as well 👍


Do we need to pass adapter.Env during request process time

When making Check and Report process calls to the adapters, should we pass the adapter.Env object ?
Comment from @ZackButcher
I think we also need to include a adapter.Env parameter in the generated golang version (it doesn't make since in the gRPC version). ATM there's no way for an adapter to log while processing, since we tuck the logger behind Env in adapters.
The idea is that we could do something like embed the span from the current trace into the environment, and have env.Logger() produce logs that are attached to the trace, rather than the glog based logger implementation we use today. Just one example, but anything of that nature will change per request. #798

Closing as a dupe of https://github.com/istio/mixer/issues/820, which I filed just barely before you :P


Having a Tagless Final version of the API

Hi, It's quite difficult to compose logic with a rigid datatype like :
type ClientConfig = (ClientEnv, Project)
type BlockfrostClient =
  ExceptT BlockfrostError
    (ReaderT ClientConfig IO)

I would have expected using the API that way :
getTx :: BlockfrostClient m => TxHash -> m Transaction
-- vs
getTx :: TxHash -> BlockfrostClient Transaction

And be able to compose my logic that way :
myOwnLogic ::  (BlockfrostClient m , OtherClient m ) => Hash -> m (Tx,Tx')
myOwnLogic  hash = do
  tx <- getTx hash
  tx' <- getTxFromOtherClient hash
  return (tx,tx')

what do you think ?

Hi, sounds good to me but to be honest, I'm not sure how to convert it to tagless final right away. If you have good example I can take a look at or draft a solution here it would help a lot.
Regarding breaking the API - I don't think there are that many users of this library so it should be fine.

I've remembered about https://jproyo.github.io/posts/2019-03-17-tagless-final-haskell.html and it makes sense, having a typeclass BlockfrostClient (or maybe just Blockfrost to avoid name clashes) with instance that can possibly call the fixed mtl client functions. What I'm not sure about is ReaderT containing Project, maybe we can just wrap our old BlockfrostClient type though. I'll play with it a bit!

Hi, I've opened #11 which adds MonadBlockfrost class allowing you to use a custom monad instead of the default BlockfrostClient.
Using this I was able to compose it with example TestapiM like this:
class Monad m => TestapiM m where
  mGetTest :: m Bool

sample :: (MonadBlockfrost m, TestapiM m) => m ()
sample = pure ()

type GlobalConfig = (Bool, ClientConfig)
type App = ReaderT GlobalConfig (ExceptT ClientError IO)

runApp :: ClientConfig -> App a -> IO (Either ClientError a)
runApp globalC = runExceptT . flip runReaderT (True, globalC)

instance TestapiM App where
  mGetTest = fst <$> ask

instance MonadBlockfrost App where
  liftBlockfrostClient act = getConf >>= \(env, _prj) ->
    (liftIO $ runClientM act env)
  getConf = snd <$> ask

Would this work for you?


Upgrade devcontainer to Go's version to 1.19

Expected Behavior
Opening a CodeSpace of a container in VS Code as defined by component-contrib devcontainer should provide an environment using Go (and all its dependencies) version 1.19, as this is the version targeted for the upcoming Dapr 1.9 release.
Actual Behavior
The image currently in use by components-contrib is ghcr.io/dapr/dapr-dev:0.1.8, which is tracking Dapr 1.8 and Go 1.18.

I agree that there is work on dapr/dapr to be done but creating a new image in dapr/dapr won't fix this issue here.

All I'm saying is that we have done this several times before and it's just part of the release process to also bump the devcontainer images. The work to bump the Go version only needs to be done in dapr/dapr, and contrib gets it for free.
We can decide in the future whether we should bump the devcontainer mid release whenever we bump the Go version - that's perhaps the real question here!
For tracking purposes I do think this belongs in dapr/dapr but it doesn't matter.


sensitive to h2o2

is there a reason why sensitive to h2o2 is not a child of sensitive to oxidative stress?
Original comment by: Antonialock

@bahler
@manulera
i think we could add this parentage. I don't really fully understand why it could not be added. Maybe @Antonialock does?
Maybe because  causes problems that are not directly related to oxidative stress?
but based on the GO hierarchy, it should probably be added:
https://www.ebi.ac.uk/QuickGO/term/GO:0070301

I asked for this connection - I never fully understood the reason but I suspect it might have to do with that certain chemicals could induce a range of different stresses.
For example, addition of CaCl2 could induce salt stress, osmotic stress, calcium stress (I suppose?!).
From memory there are other chemicals in the FYPO 'sensitive to...' branch that induce oxidative stress: t-BOOH, menadione...

being pragmatic, I agree users would exprect to retrieve 'sensitive to hydrogen peroxide' from 'senstive to oxidative stress' so I added the additional parent "sensitive to oxidative stress'
We can deal with any fall out later.

That's better.


Update solid-mission-vision-values.md

Hi Explaining the Vision Panel, there are many conversations related to this panel that are listed on the panel.md and you have been reaching out to me independently. What I'll do is close the issues and pull requests, leave them listed in panel.md for reference and start a single email conversation with all of you involved so you can coordinate between yourself to submit a final proposal for editorial review.


Split local function and function won‘t return error

Moved to https://forum.beyondstorage.io/t/split-local-function-and-function-won-t-return-error/194


Pthreads examples

Create an example program that shows how to create multiple threads. Put the code in the threads/ directory.

@nks5295, @phil-lopreiato, @atryus

When solving this issue, we basically did #13 so we're dropping this one and doing that one instead.

OK, I will unassign you from this issue.  If someone else wants to take this on add a comment.*

I will be doing this as I couldn't contribute anything for issue: ring buffer data structure.

I can't assign the issue to you until you accept the organization request--you can probably do that here: https://github.com/gwAdvNet2015

I accepted the invite. Thanks.


Handle STOP SLAVE and multithreaded replication

From the 5.7 docs for CHANGE MASTER https://dev.mysql.com/doc/refman/5.7/en/change-master-to.html

When using a multithreaded slave (in other words slave_parallel_workers is greater than 0), stopping the slave can cause “gaps” in the sequence of transactions that have been executed from the relay log, regardless of whether the slave was stopped intentionally or otherwise. When such gaps exist, issuing CHANGE MASTER TO fails. The solution in this situation is to issue START SLAVE UNTIL SQL_AFTER_MTS_GAPS which ensures that the gaps are closed.

tl;dr If you're using multithreaded replication (MTS) and you've run STOP SLAVE, the replica might end up in a state where CHANGE MASTER can't be run and there's an extra command to run.
From searching this repository I don't see mention of SQL_AFTER_MTS_GAPS so adding it here.
Gaps aren't an issue with slave_preserve_commit_order=1 and slave_parallel_type=LOGICAL_CLOCK, but from the orchestrator docs those settings are only required by orchestrator if using pseudo-GTID. But pseudo-GTID is optional.
https://dev.mysql.com/doc/refman/5.7/en/replication-features-transaction-inconsistencies.html

Thank you, I wasn't aware of that limitation.


Update renderers.py

remove initial encoding, which is already set in Workbook init.

Have you test it with non-ascii characters?

Yes, that was the initial reason, why i debugged it. The standard encoding was changed in openpyxl 2.4


Support earlier versions of Angular

Currently only Angular 14 cli is present, but I sometimes need earlier versions for older projects that haven't been upgraded.   Having versions that go back at least 2-3 versions would be helpful.
https://angular.io

I'm just curious, I can't seem to find the existing Angular 14 package in nixpkgs. Has it been removed?


a simple script to upload test data sets via the API

this is able to upload all the test datasets, including the ones
with encoded values (days, objectIds, etc.)

Current coverage is 79.70%

Merging #1157 into master will decrease coverage by -0.07% as of 62a9d8d

@@            master   #1157   diff @@
======================================
  Files          162     162
  Stmts         8830    8830
  Branches       263     263
  Methods          0       0
======================================
- Hit           7044    7038     -6
  Partial          0       0
- Missed        1786    1792     +6

Review entire Coverage Diff as of 62a9d8d

Powered by Codecov. Updated on successful CI builds.

👍🏾

5.0.11


Replace custom templating with python Template.

Instead of chaining string.replace, use Template strings from the Python standard library.

See #179

I really like this.  We're currently backed up on testing at the moment so it'll be a little while for us to merge unfortunately.
@ramonpetgrave64  I think that this approach will work well to fix #183, as we can parameterize r here and here to either a [DENIED_BY] or an [ALLOWED_BY] relationship.

I'll test this one later today or tomorrow.


[Theme Request] Rimuru Tempest

Who/What do you want to be featured?
Rimuru Tempest (That Time I Got Reincarnated as a Slime)
What do they look like?
Episode 26 open (0:41) - Nice Rimuru
Episode 40 open (1:42) - Badass Rimuru

What type of theme?
(probably one for nice and the other for badass/demon-lord Rimuru)

[x] Light Theme
[x] Dark Theme

Additional Information (Optional)

They are best slime
Damn they be photogenic
In one month I binged through all 3,800 pages of the 12 volumes of the novel that have been translated so far
Again, he be best slime

I was already planning making this theme later this year, thanks for saving me the hassle of making this issue!

I thought of it because I found this image on DeviantArt while looking them up.

I don't expect you to make a ton of variants or anything, but having a version with his aura coming off him would probably look sweet.


fix group table overflow arrow and add/fix labels

Fixes:
ySomicToday at 03:03
Also on mobile, the sortable table has an arrow for me (probably from a column that's hidden duo responsive design)

Adds label for displayName

Thanks


Plugin filled its own directory with >3500 temp files

I opened the plugin folder today to update the tsserver and found that there were 3686 (!) temp files of the form .tmpbufXXXX in the folder. They total to about 20 MB.
What is their purpose? Are these supposed to be cleaned out periodically?
This is OS X with the latest Sublime Text 3 beta build.

To reload the content of a file in tsserver, we need a way to pass the new file content to the server. The current way of doing it is to store the file content to a temp file and send the temp file location to the server.
Those temp files are designed to be recyclable. We only expect a small number of them to be created. Note that we only need to 'reload' the file that we are currently editing.
The problem here could be that after receiving a 'reload' command, by some reason (e.g. a bug) tsserver fails to send back an ACK response, the temp file used in this command will not be marked to for recycling. If this problem presents for a while, new temp files will be created and start building up.
Those temp files can be safely deleted after existing Sublime Text. We can add a logic to clean them during starting/closing Sublime Text.

The number of file should be so large though. How large is your project?

The project isn't too large: It has 52 core code files and 7 external typed dependencies (which have large .d.ts files)

The tmpbuf files are only used to reload the buffer. So the supposed process is:

the plugin writes the buffer content to a tmpbuf file
the plugin sends a request to the server to load from that tmpbuf file
the server sends back a response after the loading is finished
upon receiving the server's response, the plugin marked the tmpbuf file as ready to reuse

Therefore the most likely explanation of having so many tmpbuf files is that the server didn't respond after finishing the reload. So could you do the following to help us diagnose the problem:

go to the "[Plugin Folder]\typescript\libs\global_vars.py", change the LOG_CONSOLE_LEVEL = logging.DEBUG
restart sublime, and try to repro the problem
open your sublime console via ctrl + ` , paste the log info here

@LPGhatguy And as this issue does have some serious perf impact, would you be able to do a skype session if that would us find the problem quicker? I tried to edit files in your https://github.com/LPGhatguy/basis repo, didn't notice much differences. Thanks

Yeah, definitely. Shoot me an email and we can plan out when to do that.

I have a similar issue, where the directory is filled with more than 6000 tmpbuf files. I'd be happy to help solving this issue !

We can add a logic to clean them during starting/closing Sublime Text.

I think this is necessary. There are more than 80,000 of these files in my folder.

My recommendation would be something like the following:

Put all of these folders in a runtime cache folder in your plugin's directory, like /TypeScript/cache
Add logic to delete the cache folder when sublime text exits. This should probably be done in a separate process that periodically checks to see if the plugin_host still exists (e.g. the parent process).
Alternatively, you could just delete the cache on startup instead of exit.


Apigateway method does not seems to work

What happened?
With AWS provider 0.27.0, i am trying to deploy a method on a RestAPI :
apiVersion: apigateway.aws.crossplane.io/v1alpha1
kind: Method
metadata:
  name: test-method
spec:
  deletionPolicy: Delete
  forProvider:
    authorizationType: NONE
    httpMethod: ANY
    region: eu-west-1
    restApiId: <apiID>
  providerConfigRef:
    name: aws-provider

No event are generated, the resource is never deployed, not ready, not synced (no logs in aws provider pod) :

This issue happens for domain name as well.

How can we reproduce it?
Deploy a method or a domain name on apigateway.aws.crossplane.io group version v1alpha1

What environment did it happen in?
Crossplane version: 1.6.3
AWS Provider : 0.27.0
Kubernetes version : v1.21.9-eks-0d102a7
Kubernetes distribution : EKS

Apigateway RestAPI and Resource objects were introduced in https://github.com/crossplane/provider-aws/pull/1230, and those are currently the only objects available for the apigateway service.


'definitions' not generated for models listed under a subtype

Please take the time to search the repository, if your question has already been asked or answered.

What version of the library are you using?
2.9.0-SNAPSHOT, (waiting for artifact to be available in maven repository)

Is it the latest version?
Yes

What kind of issue is this?

'definitions' not generated for models listed under a subtype.
In the below example #/definitions/Kennel is missing the definitions body in the generated swagger doc.
The same works if the models are concrete, but document is missing Kennel when there is a subtype involved.
Model:
    @ApiModel
    public static class TestRsp {
        private String testOutput;
        public String getTestOutput() {
            return testOutput;
        }
        public void setTestOutput(String testOutput) {
            this.testOutput = testOutput;
        }
    }

    @ApiModel
    public static class TestReq {
        private Animal query;
        private String testInput;
        public String getTestInput() {
            return testInput;
        }
        public void setTestInput(String testInput) {
            this.testInput = testInput;
        }
        public Animal getQuery() {
            return query;
        }
        public void setQuery(Animal query) {
            this.query = query;
        }
    }

    @JsonTypeInfo(
            use = JsonTypeInfo.Id.NAME,
            include = JsonTypeInfo.As.PROPERTY,
            property = "type",
            visible = true
    )
    @JsonSubTypes({
            @JsonSubTypes.Type(value = Cat.class, name = "Cat"),
            @JsonSubTypes.Type(value = Dog.class, name = "Dog")
    })
    @ApiModel(value="Animal", discriminator = "type", subTypes = {Cat.class, Dog.class})
    public static abstract class Animal {
        public String type;
        public String getType() {
            return type;
        }
        public void setType(String type) {
            this.type = type;
        }

    }
    @ApiModel(value="Cat", parent = Animal.class)
    public static class Cat extends Animal {
        public String value;

        public String getValue() {
            return value;
        }
        public void setValue(String value) {
            this.value = value;
        }

    }
    @ApiModel(value= "Dog", parent = Animal.class)
    public static class Dog extends Animal {
        public String value;
        public Kennel home;

        public Kennel getHome() {
            return home;
        }

        public void setHome(Kennel home) {
            this.home = home;
        }

        public String getValue() {
            return value;
        }
        public void setValue(String value) {
            this.value = value;
        }
    }
    @ApiModel(value="Kennel")
    public static class Kennel {
        public String material;
        public String getMaterial() {
            return material;
        }
        public void setMaterial(String material) {
            this.material = material;
        }
    }

definitions in Swagger.json:
  "definitions": {
    "Animal": {
      "type": "object",
      "discriminator": "type",
      "properties": {
        "type": {
          "type": "string"
        }
      },
      "title": "Animal"
    },
    "Cat": {
      "title": "Cat",
      "allOf": [
        {
          "$ref": "#/definitions/Animal"
        },
        {
          "type": "object",
          "properties": {
            "type": {
              "type": "string"
            },
            "value": {
              "type": "string"
            }
          },
          "title": "Cat"
        }
      ]
    },
    "Dog": {
      "title": "Dog",
      "allOf": [
        {
          "$ref": "#/definitions/Animal"
        },
        {
          "type": "object",
          "properties": {
            "home": {
              "$ref": "#/definitions/Kennel"
            },
            "type": {
              "type": "string"
            },
            "value": {
              "type": "string"
            }
          },
          "title": "Dog"
        }
      ]
    },
    "TestReq": {
      "type": "object",
      "properties": {
        "query": {
          "$ref": "#/definitions/Animal"
        },
        "testInput": {
          "type": "string"
        }
      },
      "title": "TestReq"
    }
  }

Possible duplicates #2524

Possible duplicate of #2611

@dilipkrish  is this issue fixed or is there a workaround for it??

Its not fixed, Will fix it in the next release

@dilipkrish any ballpark dates for the next release? I'm experiencing this bug too.

I have found some kind of workaround for this issue. When you define your swagger configuration, you can define additional Models  for springfox:
@Bean public Docket createRestApi() {     return new Docket(DocumentationType.SWAGGER_2)     		.additionalModels(typeResolver.resolve(AdditionalModel.class)) }
The documentation says to use this fuction when some models in the application that are not "reachable". So this sitation perfectly fit in, due to this issue.
http://springfox.github.io/springfox/docs/current/#springfox-spring-mvc-and-spring-boot

@dilipkrish , I fixed that as a part of model enhancement work. I think It would be better if you review my changes.

Awesome to see that work, @MaksimOrlov. We've run into this issue with a fair number of classes needing to be declared in additionalModels, and would love to be able to use those changes.
Is it likely that everything currently on master, and not in 2.9.2, will probably need to wait for 3.0.0?

I am facing a related issue. The definitions are generated but the properties under the definition are not generated.
In the swagger json file, I get this output
{
"definitions": {
"Entity": {
"type": "object",
"title": "Entity",
"description": ""
},
"Instance": {
"type": "object",
"title": "Instance",
"description": ""
}
}
}
I was expecting this
{
"definitions": {
"Entity": {
"type": "object",
"required": ["iri", "name", "subClassOf"],
"properties": {
"displayLabel": {
"type": "string",
"description": "The display label of the entity"
},
"iri": {
"type": "string",
"description": "The iri of the entity"
},
"labels": {
"type": "array",
"description": "The labels of the entity",
"items": {
"type": "string"
}
},
"name": {
"type": "string",
"description": "The name of the entity"
},
"subClassOf": {
"type": "string",
"description": "The super class of this entity"
}
},
"title": "Entity",
"description": "Represents an Entity in the semantic object model"
},
"Instance": {
"type": "object",
"required": ["displayLabel", "instanceOf", "name"],
"properties": {
"displayLabel": {
"type": "string",
"description": "Display label of the instance"
},
"instanceOf": {
"type": "string",
"description": "Class of this instance"
},
"name": {
"type": "string",
"description": "Name of the instance"
}
},
"title": "Instance",
"description": "Represents an instance of an Entity or a Relation"
}
}
}
I am current using version 2.9.2 of springfox. Do you have a timeline on this fix? Is it applicable to my issue as well?

Exactly the same issue for me. Is a fix planned ?
Exploring sources I found that DefaultModelDependencyProvider#resolvedSubclasses is not getting dependencies recursively.

@jackkoppa. The fix is available only in 3.0.0-SNAPSHOT version.


fix: revert to generating commonjs for esm and commonjs support

closes: #405
This is how the original package had its rollup config

@mrlubos This PR actually needs more work. We need to modify the bin.js to be commonjs


command.local.Triggers docs are empty

What happened?
command.local.Triggers has no docs, so I don't have any idea how it works: https://www.pulumi.com/registry/packages/command/api-docs/local/command/#triggers_nodejs
Steps to reproduce
n/a
Expected Behavior
Docs
Actual Behavior
No docs
Output of pulumi about
No response
Additional context
No response
Contributing
Vote on this issue by adding a 👍 reaction.
To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).

It's in the schema, but doesn't seem to be emitted in docsgen.
https://github.com/pulumi/pulumi-command/blob/25825b86639ef19b63726a13f9819d3d9f597da1/provider/cmd/pulumi-resource-command/schema.json#L79-L85
Thanks for filing.

It is available now:


Initial index not working with select(index: Int)

Hello,
After migration to 2.0.1 I realized that starting paging view controller with initial index not working.
Please see the code: https://gist.github.com/rocxteady/a731d40a939e9f8a295326ef12d50984
Thank you.

This is the commit that made the problem occurred: https://github.com/rechsteiner/Parchment/commit/15a8ba95ff70bc86a81ffa4f872101aa38266e79
But I don't know what caused it exactly.

Same problem. We are waiting for the situation to be corrected

Thanks for the report! I’ll try to get this fixed later today

This should be fixed now. I need to do a bit more testing before creating a new release, so you need to target the master for now. Let me know if you find any issues!

Thank you @rechsteiner 🙏

I just tested it with the latest master and it still doesn't seem to work.
pagingViewController.select(index: 3) -> go to index 4
But in viewDidAppear it works fine.


Add selection replacement

Resolves #375

Very nice, thank you for this!

@evmorov 👏  Thank you!


Horizontal alignment of filled fields with pdf-form-fill.js

I'm running into problems with the default alignment of filled fields when using the pdf-form-fill.js script. I think I'm hoping that there's some way to set a default alignment for the form XObject that gets created in writeAppearanceXObjectForText().
Referencing Issue #12 I've been able to manually set a y-offset using TD worked well enough. But I'm trying to fill in a form that has fields that should have a mixture of horizontal alignments. There's a comment mentioning that you're not supporting the quadding of the containing acroform. My pdf knowledge is decidedly shaky, but I think "supporting" this would give me correct horizontal alignment in the form I'm trying to fill. If anyone has some pointers on edits I might make to happen It'd be a real lifesaver. I've been banging my head against this wall for quite a while now

look into this:
https://github.com/galkahana/HummusJSSamples/tree/improve-form-filling
im working on a version that allows you to input a system font, and the code will take it from there (also properly aligning in vertical)


Add transparent proxy support for OpenBSD

Add transparent proxy support for OpenBSD with pf divert-to.

Here's some notes.
implementation
There is other way to implement transparent proxy on OpenBSD, by imitating macOS/FreeBSD implementation by using rdr-to and nat-to rule. Here's pf rule for rdr/nat implementation.
pass out on egress proto tcp from $mitm_if to port { 80, 443 } nat-to <IP_ADDRESS> rdr-to <IP_ADDRESS> port 8080

The rule first NAT outgoing connection to <IP_ADDRESS> and then redirect traffic to <IP_ADDRESS>:8080 so that mitmproxy can receive the traffic. mitmproxy can inspect destination host by using pfctl -s state command (just like how mitmproxy does on osx and FreeBSD) and connect to remote host. This approach has following problems.

Recent OpenBSD replaces sudo to doas, so platform/osx.py should be updated to use doas on OpenBSD or user should install sudo from ports.
mitmproxy/platform/pf.py should be changed to deal with OpenBSD pfctl output.
pfctl -s state will be executed on every new connection, which seems quite inefficient.
It uses two ports on <IP_ADDRESS> for each connections, so port space can be exhausted if there are lots of clients/connections. The problem can be avoided by using multiple address and NAT address pools, but it requires additional configuration.

divert-to
divert-to seems to be supported on FreeBSD PF[1], so FreeBSD implementation/documentation can be changed to use divert-to rules, which doesn't require pfctl to inspect pf states. Unfortunately divert-to is not supported on macOS.
[1] https://www.freebsd.org/cgi/man.cgi?query=pf.conf&sektion=5
[2] https://developer.apple.com/legacy/library/documentation/Darwin/Reference/ManPages/man5/pf.conf.5.html

This looks fantastic, thanks! divert-to is indeed way better than pfctl -s state when available, so I strongly agree with your thoughts.
Thanks! 🎉 🍰 😃


Validate an EVSE exists.

These changes apply to K01.FR.28.
If the specified EVSE does not exist, then validation should reject it.

@shankari Please review these changes. They are based off of the work for validating a TxDefaultProfile, which is still in review.


Fix TCP_KEEPALIVE on Darwin

This patch corrects a bad magic number used to set the socket option
TCP_KEEPALIVE on Darwin hosts when Python does not provide a definition
of its own (e.g. Python v2.7.10)
On Darwin 10.11, the mappings in <sys/socket.h> for the incorrect
magic value (0x10) and TCP_KEEPALIVE are as follows::
#define SO_KEEPALIVE    0x0008      /* keep connections alive */
#define SO_DONTROUTE    0x0010      /* just use interface addresses */

So the value has been changed from 0x10 -> 0x08, and this has resolved
issues experienced with unconnected listening sockets (error: [Errno 60]
Operation timed out)
.. [1] Source available at
http://www.opensource.apple.com/source/xnu/xnu-3247.1.106/bsd/sys/socket.h XNU-3247.1.106 corresponds to Darwin 10.11 (according to http://www.opensource.apple.com/release/os-x-1011/)

setsockopt values are namespaced:
setsockopt(SOL_SOCKET, SO_KEEPALIVE)
setsockopt(IPPROTO_TCP, TCP_KEEPALIVE)

and the code already flips SO_KEEPALIVE:
s.setsockopt(socket.SOL_SOCKET, socket.SO_KEEPALIVE, 1)

TCP_KEEPALIVE seems to live in tcp.h, are you sure it's value has changed?
"Operation timed out" actually seems to hint the logic works as intended...

"issues experienced with unconnected listening sockets" - could it be you just should not set keepalive on listening socket?  i don't think the setting will be inherited by child sockets anyway.

Interesting, I hadn't noticed the name-spacing, Indeed, the value for TCP_KEEPALIVE is 0x10 as you say:
http://www.opensource.apple.com/source/xnu/xnu-3247.1.106/bsd/netinet/tcp.h
#define TCP_KEEPALIVE           0x10    /* idle time used when SO_KEEPALIVE is enabled */

My application sets the TCP_KEEPALIVE option (via SkyTools) on my listening IPv4 socket. On Linux this does what I would expect: nothing until the socket is connected (via accept()). The new socket then seems exhibit the TCP keep-alive behaviour I would expect.
On Darwin, the listening sockets times out after the configured keep alive interval before any connections have come in. So I was looking for Darwin-specific code that might be the cause.
So I was wrong - I've confused SO_KEEPALIVE with TCP_KEEPALIVE. Thanks for looking into this pull request, sorry to waste your time!


Feat Implement threads API

Describe the change
This branch implements threads API
Describe your solution
Create a new implementation file dedicated to this API
Tests
tests attached in thread_test.go
Issue: https://github.com/sashabaranov/go-openai/issues/533

@sashabaranov In this PR I need withBetaAssistantV1() from this PR. So as soon as you merge it I'll be able to complete this one.

@henomis #545 was merged! 三GO

@sashabaranov done! 🔥


Add high-level info about indexing/sorting to Metadata > EDTF documentation

I asked some questions about this in the I8 Slack channel.
I plan to add the resulting info to this documentation, with appropriate disclaimers that default behavior is being described and folks should confirm with their I8 admin.
Feel free to add any corrections or additions to the info shared on Slack in the comments here.

Ah, I was going to assign this to myself, and tag it with documentation, but do not appear to have those powers. :-)


Export intermediate efi file in enki build-uki

Right now, the only output of enki build-uki command, is an iso. The uki file itself is inside the iso. We should have a way to export that intermediate file as well, because it's needed for the upgrade process.
see https://github.com/kairos-io/enki/pull/27#issuecomment-1905624458 for more details
relates to #870

The upgrade process doesn't need an iso right? This means the command should either produce an ISO or a UKI file, not both. Or we can always output both and have a flag --no-iso to skip the ISO building part.
Alternatively, we split in 2 different commands build-uki-iso and build-uki but we would have to change the calls wherever we already used build-uki.

https://github.com/kairos-io/enki/pull/45


WIP  added searchKeywords update action

Hi,
I added setSearchKeywords update action to the Product Sync.
Plz review @emmenko @hajoeichler
thanks
for some reason this test fails though- although absolutely nothing has changed in that function - so it must have been an existing issue which looks more backend related:
  1) Integration Products should search for suggestions
   Message:
     Expected [  ] to equal [ { text : 'Schweizer Messer' } ].

The test case fails because your project does not have the correct language settings.

We need to take care about the white/black listing of attribute changes.
This is necessary eg. if the CSV later contains the column or not. Otherwise we would delete the searchKeywords just because they weren't present in the CSV.

FYI: the new sdk has already support for search keywords.
https://github.com/sphereio/sphere-node-sdk/blob/rewrite-2.0/lib/sync/product-actions.js#L19
https://github.com/sphereio/sphere-node-sdk/blob/rewrite-2.0/test/sync/product-sync-base.spec.js#L126-L184
The mapping function did change a bit though and got simplified because of the special structure of keywords.
https://github.com/sphereio/sphere-node-sdk/blob/rewrite-2.0/lib/sync/product-actions.js#L359-L381

@hajoeichler ok this would have to be done in the importer right? Not in the SDK here right?
@emmenko thanks but is the 2.0 ready to be used? Are there any interface differences? I need the search keywords update action in the CSV Product Synch and switching to 2.0 sounds like a risk to me at this point.
Are you happy for me to merge the change?

I'm not saying to switch to 2.0 (not yet), just wanted to point you to the implementation in case you needed help.

@emmenko ok - it seems like your code seems to automatically merge right? The one I implemented is simply replacing based on the new object, so the person who uses this needs to take care of the merging themselves. In the typical CSV importscenario  you need to give the search keywords for all locales. I guess I should mention that in the release notes.

actually, wait.. I just realised we need to merge..

@emmenko @hajoeichler ok I added the delta encoding for search keywords. unfortunately it's messy due to the structure of the search keywords as I need to invalidate the update action if nothing to update, and need to filter out empty text elements .. now tests are failing, will investigate why..

It's tricky with the search keywords. I've managed to solve it with the patch, but make sure to have the same config that I have if you want to use it, otherwise it won't work (I'm talking also about diffpatcher config / version).

@hajoeichler @emmenko it seems like the tests fail randomly :( when I increase the timeout, they go all through apart from 1) Integration Products should search for suggestions.. but nothing has changed there
What would you suggest I should do? I desparately want to merge my new feature

So tests are working now again. Just the code coverage that went down..

:boom: ! I knew it, my code was correct, and that the world was the problem! ;)
I guess I can now merge it right?

/cc @hajoeichler @emmenko


Close on swipe not working properly

I am using react-native-modal component into for displaying some pictures and i want to close this modal on some swipe event but when i use swipe event this not working very well or expected modal is stuck in centre of the  sometimes and even there is also a jerk while closing modal, and modal is not closing even after on reaching swipeThreshold.
Here is my code.
 <Modal           isVisible={this.state.modalVisible}           swipeDirection='left'           swipeThreshold={90}           onSwipeComplete={()=>this.handleCloseModal()}         >           <MediaView  mediaData={this.props.data} />         </Modal>

Hey @appify-waheed we just renamed the onSwipe prop to onSwipeComplete, you're probably using the version that uses the onSwipe name only.
Could you please use the latest beta version of react-native-modal?
npm i -S<EMAIL_ADDRESS>add<EMAIL_ADDRESS>(or just rename onSwipeComplete to onSwipe).

@mmazzarolo i tried with<EMAIL_ADDRESS>and also with onSwipeComplete but the behaviour is same as previous it stuck sometimes on the centre and not closing properly.
        <Modal           isVisible={this.state.modalVisible}           swipeDirection='left'           swipeThreshold={50}           onSwipeComplete={()=> this.handleCloseModal()}         >

@appify-waheed are you saying that both onSwipe and onSwipeComplete are not being triggered?
Is handleCloseModal being triggered correctly?

@mmazzarolo i am only using onSwipeComplete and my handleCloseModal function is working fine.
handleCloseModal=() => { this.setState({modalVisible: null}) }

could you try onSwipe instead?

Yes  i tired but same as previous.

@appify-waheed Can you provide a reproducible repository ?


If crashmonkey runs to different app, how can it be detected?

Hi Mokemokechicken, I wanna ask how do you detect if the UIA runs on different app?
I notice in your demo (as attached screenshot) you can detect the different app and force to stop the current instruments task. But when I tried with your version it can't detect, the UIA just hangs over there unless manually taps it back. I also traced your code but not found relative coding. Can you give a hint how did you do that? Thanks!!

https://github.com/jonathanpenn/ui-auto-monkey/pull/20
Here is the solution!! Great


Optimize normal shuffle by coalescing smaller batches on host

This optimizes the normal (legacy) Spark shuffle when using the plugin by coalescing smaller shuffle partitions on the host before copying the data to the GPU.  This reduces the number of GPU copies and allows tasks to perform this coalesce in parallel during shuffle without holding the GPU semaphore as it did before.  The GPU semaphore is only acquired when the coalesce happens which for many queries is sufficient to coalesce the entire shuffle input on the CPU.
A new ShuffleCoalesceExec node will appear in query plans immediately after GpuColumnarExchangeExec nodes when using normal shuffle.  This replaces the GpuCoalesceBatches node in most cases, as the coalesce is occurring on the host specific to the serialized shuffle tables rather than a general table concatenation on the GPU implemented by GpuCoalesceBatches.

@andygrove I tried to update the code to properly handle what AQE will do to shuffles, but I'm not very familiar with that area.  It would be great if you could double-check the code.

build

build

@abellina @andygrove @revans2 I think this is ready for another look.

build

Looking to build this and give it a whirl with UCX, will chime in if anything shows up.

Ok I tried this with adaptive on and UCX on, and I see the coalesce node getting added after a custom shuffle reader. Also tried it with adaptive off, not seeing any issues.

The AQE changes look good to me.

There's one test failure you probably already saw, I think we just need to change the comparison on https://github.com/NVIDIA/spark-rapids/blob/branch-0.3/tests/src/test/scala/com/nvidia/spark/rapids/AdaptiveQueryExecSuite.scala#L176 to ShuffleCoalesceExec

build

I've updated the AQE join test to check for both forms of ShuffleCoalesceExec that can occur as inputs to a shuffled hash join.

build


The TypeScript language service died unexpectedly 5 times in the last 5 Minutes.

Issue Type: Bug
tryied to open my project and see this issue
VS Code version: Code 1.42.0 (ae08d5460b5a45169385ff3fd44208f431992451, 2020-02-06T10:51:34.058Z)
OS version: Windows_NT x64 10.0.18363

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz (8 x 3408)

GPU Status
2d_canvas: enabledflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmetal: disabled_offmultiple_raster_threads: enabled_onoop_rasterization: disabled_offprotected_video_decode: unavailable_offrasterization: enabledskia_renderer: disabled_offsurface_control: disabled_offsurface_synchronization: enabled_onvideo_decode: enabledviz_display_compositor: enabled_onviz_hit_test_surface_layer: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
undefined

Memory (System)
15.96GB (6.39GB free)

Process Argv

Screen Reader
no

VM
0%

Extensions (14)

Extension
Author (truncated)
Version

ng-template
Ang
0.900.11

npm-intellisense
chr
1.3.0

vscode-eslint
dba
2.0.15

vscode-html-css
ecm
0.2.3

vscode-npm-script
eg2
0.3.11

auto-rename-tag
for
0.1.1

code-runner
for
0.9.15

beautify
Hoo
1.5.0

Angular2
joh
8.3.1

vscode-typescript-tslint-plugin
ms-
1.2.3

typescript-hero
rbb
3.0.0

sass-indented
rob
1.5.1

vscode-icons
vsc
9.7.0

html-css-class-completion
Zig
1.19.0

Does this reproduce in the latest VS Code insiders build with all extensions disabled?

My bad. It was mistype in tsconfig pathes.

Can you share the config that caused this? Misconfiguration should never cause a crash

I'm getting this as well more and more since the latest two VSCode updates.
Steps to reproduce are to start with a new react app which uses TypeScript. Add a couple of components, builds has no errors, but VSCode TS intellisense crashes all the time.


HUE-6585 [notebook] User with read permission can modify read permissions on shared notebook

Sorry, pretty late! Thanks for the patch!
Would you mind sending the review to http://gethue.com/rbtools-example-how-do-easily-do-code-reviews-with-review-board/, so that it would be easier to see?

https://review.cloudera.org/r/11009/


Unable to push data from Locust script running on Jenkins

Describe the bug
I have a locust script running in distributed mode via Jenkins. I have configured JTLReporter in the on_locust_init method just as described in the example. I also have the JTLReporter deployed and its UI accessible. I have created a new project and a scenario via the UI. I have specified their name in the configuration. When the test is run I see the following error on Jenkins
# first error [2022-11-30 12:22:40,807] ip-172-23-12-97/INFO/root: Starting async item in Reporter [2022-11-30 12:22:40,817] ip-172-23-12-97/ERROR/root: Starting async item in Reporter failed [2022-11-30 12:22:40,817] ip-172-23-12-97/ERROR/root: Error while starting the test
while trying to diagnose this error i looked at the logs generated by the JTL backend and noticed the below error.
{"level":"error","message":"Creating new async item failed error: null value in column "scenario_id" of relation "items" violates not-null constraint"}
I have enabled the create scenario if it doesn't exist option too.
Expected behaviour
Data shows up on JTLReporter

Hey @abhishek813 !

I have enabled the create scenario if it doesn't exist option too.

Yeah, I forgot ti add it for this endpoint. Needs to be added, gonna create a new issue for it.
I will try to replicate the issue, and get back to you.

the scenario exists. I'll retry. I am curious though, what should i provide in backend_url just the IP of the IP and 2020 port of the backend server?


Preview readme

Summary of the changes:

UI to display preview of readme content
Disable documentation section at manage package page when embeddedReadme feature is enabled

EmbeddedReadme flag feature enable

Uploading packages with embedded readme

Uploading packages without embedded readme

EmbeddedReadme flag feature disable:

Uploading packages with embedded readme:

Uploading packages without embedded readme:

Addresses :https://github.com/NuGet/Engineering/issues/3267

            return EmbeddedReadmeFileType.Markdown;

Do we allow the extension to be empty?

Refers to: src/NuGetGallery.Services/PackageManagement/PackageService.cs:756 in 94d7484. [](commit_id = 94d7484bebab46130e95f934c4da39b708537fd9, deletion_comment = False)

Consider adding some test coverage such as the "PackagesController", if possible.

            return EmbeddedReadmeFileType.Markdown;

Do we allow the extension to be empty? How does the client verify this?
Refers to: src/NuGetGallery.Services/PackageManagement/PackageService.cs:756 in 94d7484. [](commit_id = 94d7484, deletion_comment = False)

I think here probably better not allow extension to be empty for markdown file. I will check with Client and keep consistent


Get ExtDataDriver.x running on tiles

This allows ExtDataDriver.x to work on "tile" grids and create the locstream on an attached grid and then create 'tileonly' variables which is precursor to getting ExtData able to ingest tile data and retire MAPL_ReadForcing. This will allow me to develop without having to run the full model.
Unfortunately do to a bug or limitation (which has been reported to ESMF) when doing ESMF_FIeldCreate on grids with ESMF_USER_INDEX, I had to redo the "clone" function in the field operation utilities to have MAPL, if the grid has was created with ESMF_USER_INDEX, rather than ESMF allocate the memory, we do, which of course brings the ugly rank/type logic we want to avoid. I'm very sorry about this but until ESMF either fixes the bug or removes the limitation this is what we must do and the way it must be, it just is.
I also updated and moved the field destroy that takes advantage of the fact ESMF now can report who allocated the memory so that I can destroy these fields no matter who allocated the memory.

Description

Related Issue

Motivation and Context

How Has This Been Tested?

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Trivial change (affects only documentation or cleanup)

Checklist:

[ ] I have tested this change with a run of GEOSgcm (if non-trivial)
[ ] I have added one of the required labels (0 diff, 0 diff trivial, 0 diff structural, non 0-diff)
[ ] I have updated the CHANGELOG.md accordingly following the style of Keep a Changelog

Minor change requested. And some questions.

@tclune, turns out some external repos call "MAPL_FieldDestroy" so I should not have change the name to just "FieldDestroy", as I broke the public API which was causing the GEOSgcm build to fail.

Minor change requested. And some questions.

@tclune, turns out some external repos call "MAPL_FieldDestroy" so I should not have change the name to just "FieldDestroy", as I broke the public API which was causing the GEOSgcm build to fail.

OK - let's defer those kinds of changes until MAPL3.    There we may use things like FieldDestroy internally, and then have a compatibility layer than uses rename to the explicit name.
I would hope destroying fields is very rare outside of MAPL though ...


[Feat]dark and light toggle mode

Description
to add a  toggle of dark and light for customers view of seeing
Screenshots

Checklist

[X] I have checked the existing issues
[X] I have read the Contributing Guidelines
[X] I'm a GSSoC'24-Extd contributor
[X] I'm a Hacktoberfest'24 contributor
[X] I am willing to work on this issue (optional)

hey @sv410 thanku for raising this issue but for now we don't need night mode .You can find someother issue and make sure to
star our Repo.


drivers: bluetooth: hci_spi: fix condition causing infinte loop

With a size of 0, the inner loop will never terminate, so don't try to enter it.

@arbrauns thanks for the PR. Can you please add a signed-off-by line?
git commit --amend -s should do it.


Kia Sportage NQ5 EU: Battery Level not available

Please check Services, Known Bug / Issues and Troubleshooting over here first: https://github.com/fuatakgun/kia_uvo/blob/master/README.md
Region and Brand of car
Kia Sportage NQ5 T-GDI 1,6 Germany
Version of the integration
2.18.1
Describe the bug
Since 03.01.2024 the Car Betty Level isn't reported and it's not available.
No error message in the logs, HA restart doesn't help.
Anything else works normal.
I also made a restart of the Car Media System (the small button near to the volume control)
Debug logs if an error occurred
Outlined here: https://github.com/fuatakgun/kia_uvo/blob/master/README.md
To Reproduce
Expected behavior
Screenshots

Additional context

After a complete reinstall of this integration (delete car, delete Integration, restart HA, install integration, restart HA, connect the car) everything works fine.

Did try the same but now it's gone, can't find it anymore.

Take your car for a drive and restart the integration.
Typically this means your battery is low and the api just stops reporting the data.

You can close it :)


[BUG] Confirmation Page - Total Row Shows Full Balance after Payment

Describe the bug
On the SummitEventsConfirmation page (after making a payment), the table showing the event fees is presented to the user which appears to show the full Total Cost (which is confusing - it can be interpreted as the payment was not received)
To Reproduce
Successfully make a payment for a Summit Event Instance and you will be taken to a Confirmation Page that shows the same itemized list of fees with the same Total Balance, despite having just made a payment.
Expected behavior
If we are presenting a table on the confirmation page, and we are claiming the Payment is Received, I expect the Total Row to show a $0.00 or the Total Row should say something else like "Payment Received"
Screenshots

Included in beta release <IP_ADDRESS>

Included in production release <IP_ADDRESS>


Wrong cluster ID on VM history after cluster reorganization

Enhancement Request
Description

VMs deployed on a host which has been moved to another cluster, maintain the previous cluster ID on the last history record. Actions like attach nic to a network which is not part of the old cluster fail.
It would be very useful to add a new histroy record to log the new cluster ID.
To reproduce:
Two clusters with one host and some vnets and VMs on each one.
Reorganize hosts moving one of them to the other cluster.
Try to attach nic to a VM on a vnet of the new cluster.
Use case

You need to manually update the last history record of each VM of the moved host.
Interface Changes

N/A

Progress Status

[ ] Branch created
[ ] Code committed to development branch
[ ] Testing - QA
[ ] Documentation
[ ] Release notes - resolved issues, compatibility, known issues
[ ] Code committed to upstream release/hotfix branches
[ ] Documentation committed to upstream release/hotfix branches

In case somebody runs into this issue, here is command how to fix the cluster ID in the VM history record:
onedb change-history --id <vm-id> --seq <history-last-id> '/HISTORY/CID' <new-cluster-id>


How to prepopulate the selected choices in HeavySelect2MultipleWidget and ModelMultipleChoiceField

Goal
How to pre populate multiple selected choices in HeavySelect2MultipleWidget and in ModelMultipleChoiceField
Problem
When form reloaded with validation error, all the pre selected choices will vanish for HeavySelect2MultipleWidget, ModelMultipleChoiceField
also not finding a way to pre populate the selected choices when you load update form...
Code Snippet
class RequestRegion(forms.Form):
    region = forms.ModelMultipleChoiceField(queryset=Region.objects.all().order_by('region_id'),
                                            widget=Select2MultipleWidget)

class CustReqForm(forms.Form):

    #CustomerField(widget=CustomerHeavyWidget(data_view = 'customer_ajax', attrs={'data-minimum-input-length': 4, 'delay':200}))
    distributor = forms.CharField(
            widget=HeavySelect2MultipleWidget(data_view='customer_ajax',
                                              attrs={'data-minimum-input-length': 4, 'delay':200},
                                              ), required=False #queryset=Customer.objects.none()
    )

Hello. I also ran into a problem. When you need to edit form data, the transmitted data is not displayed. You have to re-select this data.

I'm having the same issue. Have you been able to solve this in the meanwhile?

Hello. I also ran into a problem. When you need to edit form data, the transmitted data is not displayed. You have to re-select this data.

I am afraid this is a known issue. I would love to see someone come up with a solution tho.

Do you happen to use django-crispyforms? In our case the issue was caused by the combinated use of select2 and crispy forms.

I have the same issue. Deleting django-crispyforms didn't help.

Has been any improvement in this issue?

Select2 want the preselected values as option-elements with selected="selected": https://select2.org/data-sources/ajax#default-pre-selected-values
I did this the following way:

Make the views get_form add the values I want prepopulated as option values to the ModelSelect2TagWidget of the field:
https://github.com/Kagee/homelab-organizer/blob/0dd3b4279fe1320178c92a0c5a01f54a287f7ee1/hlo/views/stockitems.py#L167
Override create_option in the widget to always set selected to "selected", as i could not get anaything like initial values to work. This will work as all the options are the options from step 1. that we want selected: https://github.com/Kagee/homelab-organizer/blob/0dd3b4279fe1320178c92a0c5a01f54a287f7ee1/hlo/forms.py#L18

If anyone have any better suggestions after seeing my workaround, please share.


Initial commit of LTE RDL

@mdwhitten does this pull request still need review?

@smooresni Yes, sorry I haven't come back to it yet. I'll try and approve it this week.

@smooresni VI Analyzer is reporting that the LTE Example is broken. I looked at it and I think you didn't update the example after changing the VI names. Could you update the example and push?

@mdwhitten fixed

LTE ACP Configuration.ctl
Something is wrong with the Averaging Type input below. I think it got copied and pasted from Averaging Enabled?

@mdwhitten not sure where this came from. Can you check again? Might have been bad linkages in the example. Should be okay now as I don't see this on my system anymore.

LTE Signal Config.vi

Can you elaborate on your decision to assume uplink?
How would supporting downlink change the function? Would it over-complicate the function?

@mdwhitten I added support for downlink test models

ModAcc Config/Fetch & ACP Config/Fetch

Thus far, all measurement modules have intentionally enabled All Traces even if not used because it makes the process easier for a user to modify the fetch later. As in, a new user might try to fetch a constellation trace from the ModAcc measurement and not know where to go to enable the trace when the error occurs. I recognize this is a hit to performance.
You have added a Measurement Enabled parameter to each of the measurement configurations rather than enabling by default. That's an interesting addition; can you elaborate on your thinking? That may be a valuable addition for other modules as well but I want to understand your thinking first. The thinking thus far is that each configure should intentionally enable the measurement for ease-of-use, and a user would later use Select Measurements in order to specifically select other measurements. Do you see an advantage to your method here?

With either of these changes I want to make a decision as to whether other modules need to be changed so that the interfaces are consistent across modules.

Changed VIs to enable all traces by default
Encapsulation. Each configuration method is responsible for enabling or disabling the measurement. Nobody else is. Helps contain measurement configuration and properties to a single VI call for that measurement. I view as Measurement Enabled as a property of the measurement itself.

/AzurePipelines Run

FYI @smooresni in commit f46070ab3290fd2978ce44379be5e0e254611d32 I connected the selector string to this VI which was missing it. I assume this was an oversight, but let me know if there is some reason it ought not be connected.

LTE ACP Configuration.ctl
Something is wrong with the Averaging Type input below. I think it got copied and pasted from Averaging Enabled?

@mdwhitten not sure where this came from. Can you check again? Might have been bad linkages in the example. Should be okay now as I don't see this on my system anymore.

The issue was somehow the typedef visible on the front panel of ACP Config.vi was out of step with the actual type def. I fixed it by making the type def strict, which forced an update on the front panel of the VI. I then reset the type def and saved the VI in commit c590387a11df1b63941b872193731e6d4876c22f


Cache dir not automatically created?

We started getting this error after this commit: https://github.com/heroku/heroku-buildpack-java/commit/db89ce68fae81d30bb7478e0a72c3666086941b5, looks like cache dir was not automatically created when writing the system.properties file to it.
buildpacks/java/bin/compile /var/EUAD4ABKBEIC7F63IDQJVTVF5ATUY6DZYKUQTKT2FUOR3Z76I5WQ/app-71 /var/EUAD4ABKBEIC7F63IDQJVTVF5ATUY6DZYKUQTKT2FUOR3Z76I5WQ/cache-71
-----> Installing JDK 1.8.../tmp/jvm-common/bin/java: line 302: /var/EUAD4ABKBEIC7F63IDQJVTVF5ATUY6DZYKUQTKT2FUOR3Z76I5WQ/cache-71/system.properties: No such file or directory

@sean-zou i assume this is not running on heroku, is that correct? In any case, it seems like a mkdir -p $CACHE_DIR will prevent this from happening.

It is not running on heroku. It was working fine before the commit.

@sean-zou this will need to be fixed in the heroku/jvm buildpack. I've created a PR for it.

Fixed by https://github.com/heroku/heroku-buildpack-jvm-common/pull/87


404 page interrupt  in class route and test route

Describe the bug
When I am visiting the classroom page, the 404 page is coming for some second and after that class page is showing up.
On the class page if clicked a floating button to create a test again 404 pages is rendered for some time.
To Reproduce
Steps to reproduce the behaviour:

Create a class
From dashboard visit classroom page i.e /class/:classId
404 page is up (error )
Scroll down to the floating button to create a test
404 page is up (error )

Expected behaviour
A clear and concise description of what you expected to happen.
404 page should not be displayed which routing the class page, test page
Desktop (please complete the following information):

OS: [e.g. iOS] WIN10
Browser [e.g. chrome, safari] EDGE
Version [e.g. 22] 89.0.774.63

Additional context
Add any other context about the problem here.
My internet connection is a little bit slow, but I don't think it is creating a problem and if it is then we should work to resolve it
https://user-images.githubusercontent.com/67755128/113243720-25818f00-92d1-11eb-95c0-7518d9c89dc7.mp4
.

@VenomFate-619 Are you willing to work on this issue ?

Yes I will do , tell me is docker setup is necessary to run project  , I am new to docker

Yes I will do , tell me is docker setup is necessary to run project , I am new to docker
No its not necessary.

share the env.example file

@aavishkarmishra can you assign me this


iOS Support

There should be an iOS version of the mod. Additionally, they should be essentially identical in features.

Not so simple to do.

Yes but it's very important. About half of the pe users are on ios

Ios system is very difficult to operate, thats why there arent that many
mods
Il 01/Set/2015 13:24, "Eli Clemente Gordillo Foster" <
<EMAIL_ADDRESS>ha scritto:

Yes but it's very important. About half of the pe users are on ios
—
Reply to this email directly or view it on GitHub
https://github.com/Esteemed-Innovation/Flaxbeards-Steam-Power-Mobile/issues/2#issuecomment-136678698
.

There's no easy API, or at least one that is updated.

Well when there is one, this should be of high priority.


Can this component be used in China？

I don't know what's going to happen to use Google Maps in China.

Apple Maps should be fine, I reckon.

AFAIK Google Maps is blocked in China, you'd have to find a different provider.
Also please use this issue tracker for bug reports and features. Questions are better suited for Stack Overflow.

@felipecsl thanks.

Surprisingly, I've found that this module works in China without VPN on both iOS and Android devices.  Our team has tested the mapping feature of our app numerous times across a period of 2 months from Shanghai, and it works for us.
The problem with our testing is it was all done on US purchased pure Android devices, or devices with Google Play installed over VPN.  This module does not work if Google Play Services is not installed.
Is there a workaround for this problem?

@stephenjen your issue is more an Android SDK, rather than react-native-maps issue. You need to change build.gradle so that it has the dependencies required. You should look for something like this:
android google maps without google play services


AttributeError: Can't get attribute 'DataEdgeAttr'

Hi, I followed the environment creation and when I tried to direct run the vanilla classification with the given yml, the error happened. I spent some time but still have no clue how to fix this. Could you help to look into this and help me out? Thank you so much!
(gpn) labcluster@lambda-:/data/xueyingy/Graph-Posterior-Network$ python3 train_and_eval.py with configs/gpn/classification_gpn_10.yaml data.dataset=CoraML
WARNING:root:The OGB package is out of date. Your version is 1.3.1, while the latest version is 1.3.4.
Using backend: pytorch
2022-10-25 23:30:22.619741: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
WARNING:root:Added new config entry: "data.dataset"
WARNING:root:Added new config entry: "data.ood_flag"
WARNING:root:Added new config entry: "data.root"
WARNING:root:Added new config entry: "data.split"
WARNING:root:Added new config entry: "data.split_no"
WARNING:root:Added new config entry: "data.test_samples_per_class"
WARNING:root:Added new config entry: "data.train_samples_per_class"
WARNING:root:Added new config entry: "data.val_samples_per_class"
WARNING:root:Added new config entry: "model.K"
WARNING:root:Added new config entry: "model.add_self_loops"
WARNING:root:Added new config entry: "model.alpha_evidence_scale"
WARNING:root:Added new config entry: "model.alpha_teleport"
WARNING:root:Added new config entry: "model.approximate_reg"
WARNING:root:Added new config entry: "model.dim_hidden"
WARNING:root:Added new config entry: "model.dim_latent"
WARNING:root:Added new config entry: "model.dropout_prob"
WARNING:root:Added new config entry: "model.entropy_reg"
WARNING:root:Added new config entry: "model.flow_weight_decay"
WARNING:root:Added new config entry: "model.gaussian_layers"
WARNING:root:Added new config entry: "model.init_no"
WARNING:root:Added new config entry: "model.loss_reduction"
WARNING:root:Added new config entry: "model.maf_layers"
WARNING:root:Added new config entry: "model.model_name"
WARNING:root:Added new config entry: "model.pre_train_mode"
WARNING:root:Added new config entry: "model.radial_layers"
WARNING:root:Added new config entry: "model.seed"
WARNING:root:Added new config entry: "model.use_batched_flow"
WARNING:root:Added new config entry: "run.eval_mode"
WARNING:root:Added new config entry: "run.experiment_directory"
WARNING:root:Added new config entry: "run.experiment_name"
WARNING:root:Added new config entry: "run.gpu"
WARNING:root:Added new config entry: "run.job"
WARNING:root:Added new config entry: "run.save_model"
WARNING:root:Added new config entry: "training.epochs"
WARNING:root:Added new config entry: "training.finetune_epochs"
WARNING:root:Added new config entry: "training.lr"
WARNING:root:Added new config entry: "training.stopping_metric"
WARNING:root:Added new config entry: "training.stopping_minimize"
WARNING:root:Added new config entry: "training.stopping_mode"
WARNING:root:Added new config entry: "training.stopping_patience"
WARNING:root:Added new config entry: "training.stopping_restore_best"
WARNING:root:Added new config entry: "training.warmup_epochs"
WARNING:root:Added new config entry: "training.weight_decay"
WARNING:train_and_eval:No observers have been added to this run
ERROR:train_and_eval:Failed after 0:00:00!
Traceback (most recent calls WITHOUT Sacred internals):
  File "train_and_eval.py", line 65, in run_experiment
    results = experiment.run()
  File "/data/xueyingy/Graph-Posterior-Network/gpn/experiments/multiple_run_experiment.py", line 50, in run
    results = self.run_transductive_experiment()
  File "/data/xueyingy/Graph-Posterior-Network/gpn/experiments/multiple_run_experiment.py", line 75, in run_transductive_experiment
    experiment = TransductiveExperiment(
  File "/data/xueyingy/Graph-Posterior-Network/gpn/experiments/transductive_experiment.py", line 96, in __init__
    self.dataset = ExperimentDataset(data_cfg, to_sparse=data_cfg.to_sparse)
  File "/data/xueyingy/Graph-Posterior-Network/gpn/experiments/dataset.py", line 58, in __init__
    dataset = DatasetManager(**data_cfg.to_dict())
  File "/data/xueyingy/Graph-Posterior-Network/gpn/data/dataset_manager.py", line 124, in DatasetManager
    data = D.CitationFull(root, 'Cora_ML', default_transform, None)
  File "/home/labcluster/.local/lib/python3.8/site-packages/torch_geometric/datasets/citation_full.py", line 39, in __init__
    self.data, self.slices = torch.load(self.processed_paths[0])
  File "/home/labcluster/.local/lib/python3.8/site-packages/torch/serialization.py", line 607, in load
    return _load(opened_zipfile, map_location, pickle_module, **pickle_load_args)
  File "/home/labcluster/.local/lib/python3.8/site-packages/torch/serialization.py", line 882, in _load
    result = unpickler.load()
  File "/home/labcluster/.local/lib/python3.8/site-packages/torch/serialization.py", line 875, in find_class
    return super().find_class(mod_name, name)
AttributeError: Can't get attribute 'DataEdgeAttr' on <module 'torch_geometric.data.data' from '/home/labcluster/.local/lib/python3.8/site-packages/torch_geometric/data/data.py'>

As far as I know,DataEdgeAttr is part of the more recent idea of connecting the Data class to the GraphStorage class (see PR). This definitely shouldn't be in the tagged version of 2.0.2.
I see two potential problems causing this issue

You already have existing datasets on your machine, but from more recent PyG versions. In this case, try deleting them and downloading them again inside the gpn environment or keep two different copies and ensure that you select the right path.
You somehow are using a different version of PyG e.g. by manually updating it inside the environment.

The issue is most likely not caused by our side as it occurs in File "/home/labcluster/.local/lib/python3.8/site-packages/torch_geometric/datasets/citation_full.py". Please check if those hints the issue solve the issue and close it eventually. Otherwise, come back to us in this thread.


400 error

I am receiving the following error message when trying to use the put step:
1.86 MiB / 1.86 MiB [===================================] 100.00% 4.17 MiB/s 0s
error running command: googleapi: Error 400: Required, required

Here is my configuration:
- name: m2-bucket
  type: google-cloud-storage
  source:
    regex: m2_tar/m2/m2.tar.gz
    bucket: {{bucket_name}}
    json_key: {{bucket_private_key}}

- name: google-cloud-storage
  type: docker-image
  source:
    repository: frodenas/gcs-resource

    - put: m2-bucket
      params:
        file: ./m2_tar/m2/m2.tgz.gz

Any ideas on what could be wrong? Thank you in advance!

I also tried the demo found here and the same error was generated.
We are running on concourse version: v4.2.1

This happens most likely because the bucket does not exist. Have you checked if the bucker is there and that the {{bucket_name}} interpolation is working?


1.0.0 Release Tasks

[x] #55
[x] #44
[x] #31
[ ] Split out sinks and instrumentation that will version separately from the core
[ ] README update for instrumentors
[x] README update for SQL client instrumentation
[x] README update for initial levelling mechanism

A combination of high and low level benchmarking of the overhead of our listener for both instrumented and non-instrumented activities would be good to know too ahead of calling this 1.0

RE splitting out projects that will version separately, I think that effectively means setting up separate repositories for all subprojects. Even ones that we'll want to "1.0" in the near future will need to evolve separately at some point.

We changed direction on splitting out repos; going to get to 1.0 with a monorepo (-lite :-)) and work forward from there.


[Spec Impl] Remove Verification status Characteristic

Background
We use a dedicated characteristic for communicating Accept/Reject status of VC by Verifier to Wallet.
What to do

We should remove usage of this characteristic. We should not have a dedicated characteristic for this.
However we need to see how we can handle UI if we are not communicating the Verification status to Wallet.
In case if we can leverage any other characteristic for communicating this information is still an option. We need to see the possibility.

This requirement has been moved to Jira.
Link to Jira ticket: https://mosip.atlassian.net/browse/MOSIP-26907


Add a time window when defining SLOs

Is your feature request related to a problem? Please describe.
Allow users to define the time window for which they want to measure their SLO.

On slo init, user will be prompted for an easy pick or custom one.
Easy picks are:

1 hour
1 day
1 week
1 month (considered arbitrary to be 30 days)

The custom duration will be asked in the iso8601 format https://en.wikipedia.org/wiki/ISO_8601#Durations
We will only support days, hours, minutes and weeks:

P[n]DT[n]H[n]M as (D)ays, (H)ours, (M)inutes
P[n]W as (W)eeks

Examples:

P10D: 10 days
PT36H: 36 hours
P3DT12H30M: 3 days, 12 hours, 30 minutes

P3W: 3 weeks

We'll have more limitations due to underlying metrics computing

duration cannot be zero
duration (seconds) will be rounded down to the closest minute (in case values are directly changed in the manifest file)
seconds are supported with limited use;  must be a multiple of 60
if manifest does not contain any time window, the default one day will be applied

PR has been merged, https://github.com/reliablyhq/cli/pull/215
closing this issue


PacBio bam files not publicly accessible

Hello, thanks for the great resource!
Just a heads up that some files under the PacBio/ folder are not publicly accessible.
For example:
# This works
➜  Desktop aws s3 cp s3://dnastack-covid-19-sra-data/PacBio/fasta/SRR16804664/SRR16804664.fasta . --no-sign-request
download: s3://dnastack-covid-19-sra-data/PacBio/fasta/SRR16804664/SRR16804664.fasta to ./SRR16804664.fasta

# This doesn't
➜  Desktop aws s3 cp s3://dnastack-covid-19-sra-data/PacBio/bam/SRR13144523/SRR13144523.aligned.bam . --no-sign-request
fatal error: An error occurred (403) when calling the HeadObject operation: Forbidden

@hkeward sadly I'm not with AWS Open Data any longer. This does look kind of weird. No one has messed with your bucket policy?

@chueatwork aha, sorry to hear that, and apologies for the summon! Not that I'm aware of. I'll continue exploring - thanks for taking a look!


cmd/bug: does nothing if there is no windowing system

What version of Go are you using (go version)?
go1.8
What operating system and processor architecture are you using (go env)?
linux/amd64
What did you do?
Run go bug on a headless system.
What did you expect to see?
Anything.
What did you see instead?
Nothing.
$ go bug
$

Let's bug @josharian.

/cc @shurcooL

$ go bug
$

What was the exit code from go bug (ala echo $?)?

Zero exit code.
On Feb 16, 2017 3:26 PM, "Dmitri Shuralyov"<EMAIL_ADDRESS>wrote:

$ go bug
$
What was the exit code from go bug (ala echo $?)?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/golang/go/issues/19131#issuecomment-280497608, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AABhls8qLX40yz78zSIthcTllu5Ufaqeks5rdNslgaJpZM4MDq2T
.

go bug should have handled the fallback case where there was no browser: https://github.com/golang/go/blob/master/src/cmd/go/internal/bug/bug.go#L63.
Would you mind instrumenting the browser opening code and finding out what's happening there? See https://github.com/golang/go/blob/master/src/cmd/internal/browser/browser.go#L38. I'd be curious about which browser command is succeeding, and what happens if you run it manually.

@broady,
Can you share any more information about the headless system you are on? I cannot experience this neither when I am ssh'ing into Debian or Ubuntu.

Able to reproduce on a headless system. web.OpenBrowser doesn't check if the command succeeds or not (only that it is runnable) and doesn't print any stderr, so if any of the browsers in https://github.com/golang/go/blob/master/src/cmd/internal/browser/browser.go#L17 are installed (xdg-utils  (providing xdg-open) is the one most probably installed on a headless system), it will silently fail on headless system with exit code of 0 without printing the body.
BROWSER=/usr/bin/false go bug
echo $?
0

It is better to log the browser being used to open (in browser.go) and/or to provide a -headless option to go bug to just print. (otherwise, checking DISPLAY and printing is not portable).

This will impact any command that opens a browser, including go trace, go tool pprof, etc.
We don't check the exit code or wait for the command because some browser commands block.
I don't want to log every time; that'd be ugly, and almost all invocations succeed.
Let's start by fixing the specific problem on the specific system, even if it is not very portable. Sounds like maybe checking DISPLAY might work?

In the last case, one can do like:
 diff --git a/src/cmd/go/internal/bug/bug.go b/src/cmd/go/internal/bug/bug.go
 index 963da94c49..214108d945 100644
 --- a/src/cmd/go/internal/bug/bug.go
 +++ b/src/cmd/go/internal/bug/bug.go
 @@ -60,7 +60,7 @@ func runBug(cmd *base.Command, args []string) {

         body := buf.String()
         url := "https://github.com/golang/go/issues/new?body=" + web.QueryEscape(body)
 -       if !web.OpenBrowser(url) {
 +       if len(os.Getenv("DISPLAY")) == 0 || !web.OpenBrowser(url) {
                 fmt.Print("Please file a new issue at golang.org/issue/new using this template:\n\n")
                 fmt.Print(body)
         }

This should work on a headless systems with Xorg (which covers everything except windows).
Tested with:
DISPLAY= $HOME/bin/go bug     # Prints to terminal

and
echo $DISPLAY
:0
$HOME/bin/go bug       # Opens browser.

DISPLAY won't work on OS X, though. (at least, I assume our target audience is not XQuartz users) Will it even work on Wayland? Or do you also have to check WAYLAND_DISPLAY?

For Wayland, yes, $WAYLAND_DISPLAY needs to be checked.  Does the X server in OSX export any similar variable?

macOS doesn't use an X server.

Could we only use display if there is a DISPLAY envvar? Or hard code some OSes?
And this code belongs in the browser-handling code, not go bug.

Regarding browser.go, strictly speaking, there are browsers which work without X server, will be harder to impose with that constraint there.
But, again, if we restrict to graphical browsers only, then one can fail early in https://github.com/golang/go/blob/master/src/cmd/internal/browser/browser.go#L20 depending on the platform (so fail only for known platforms in the beginning).

More details on my setup:
$ echo $BROWSER,$DISPLAY
,
$ which xdg-open
/usr/bin/xdg-open

Added some logs and confirm xdg-open is the command being used.
Suggested fix: wait 5 seconds for the process to exit. If it's nonzero or takes >5 seconds to return, print out the URL to stdout.
That is, keep the current behaviour if the command returns a nonzero exit code within 5 seconds.

I've seen at least one reported case where where "xdg-open" seemed to block and not return until browser was closed. To help the issue, I had to run it in a background goroutine. See https://github.com/shurcooL/Go-Package-Store/commit/a15fc561fd6d4e10f65506b3842dba7799fa4b70 and https://github.com/shurcooL/Go-Package-Store/issues/26#issuecomment-70617610.
However, this was 2 years ago, and it looked like an outdated, possibly misconfigured linux system.

Suggested fix: wait 5 seconds for the process to exit. If the exit code is nonzero or takes >5 seconds to return, print out the URL to stdout.

I think waiting 5s is reasonable. On most systems, the command exits almost immediately, so I doubt anyone will notice.
But we shouldn't print the URL to stdout. As I keep saying, the fix should go in the browser-opening code, not in 'go bug', and each individual command can decide how to handle the browser not opening; 'go bug' already has handling for that case.

Well, apparently xdg-open does also complete within 5 seconds with a non-zero exit code.
I hooked up stdin/stdout and get the following:
stderr:
/usr/bin/xdg-open: line 461: links2: command not found

stdout:
<snip>
Looking up host
<snip>

Presumably it's opening up links (I don't have links2 installed) but exiting right away.
I guess xdg-open is at fault here? It's opening up links without a tty.


Separate creating, signing, transmitting transactions.

Feature Request
Not 100% sure if this isn't already possible just wanted to make sure this can be done. From what I searched there was no examples of this.
Suggestion
Developer should be able to completely separate the process of creating, signing, transmitting and confirming a transaction.
So on one side the transaction itself for a specific chain with the metadata can be constructed then serialised. Somewhere else this transaction can be parsed and signed and serialised again. Another service can handled signed transaction to push them on chain and a completely x service can then check/validate if that transaction was accepted into the chain.
Motivation
Consider a service creating 10000 transactions on chain per hour. Like an exchange or something similar.
So it's very important that the signing process occurs somewhere with very limited access in a secure manner with high validations. While the transaction construction can happen anywhere and since the signing service does not need to be aware of the chain he is signing for there is no need for metadata. After the transaction is signed you want to push it on chain. But if you are performing tons of transactions you don't want to thing one by one waiting for transactions to be accepted. But you can have a service just pushing the transactions not waiting for them to get accepted into a block since there are tons of transactions happening.
Use Cases

Security of signing keys.
Services performing high amount of transactions.
Separating chain specific logic of transaction construction with signing the transaction which is the same for every chain.

Hi @MoMannn. I believe this is currently possible... but let's be certain:

creating

Construct the extrinsic
const call = Balances.transfer({
  value: 12345n,
  dest: billy.address,
})

signing

Sign it and collect the hex representation for later usage
const signedHex = await call
  .signed(signature({ sender: alexa }))
  .hex()
  .run()

submitting

Use that hex representation (ostensibly in another env or run) to describe the submission of the signed extrinsic.
const txStatus = Rune
  .constant(hex.decode(signedHex))
  .into(SignedExtrinsicRune, chain)
  .sent()

confirming

As for confirming, we can do this in a number of ways. One way would be to iterate over blocks within a given range and compare the extrinsic hexes. Another would be to make use of txStatus (and in doing so, initiate the submission).
const finalizedHash = await txStatus.finalizedHash().run()

Please confirm that this is what you're looking for. If not, we can certainly improve the API such that it meets your needs.
Speaking of improving the API, perhaps we should have a static fromHex method on SignedExtrinsicRune to simplify this use case.
- const txStatus = Rune
-   .constant(hex.decode(signedHex))
-   .into(SignedExtrinsicRune, chain)
+ const txStatus = ExtrinsicStatusRune.ofHex(signedHex, chain)
   .sent()

Great! Please don't hesitate to follow up with any other questions / rough edges (as we'll want to smooth them out before 0.1.0).


chore(apps/prod/tekton/configs/triggers/tests): update http test data

Signed-off-by: wuhuizuo<EMAIL_ADDRESS>

/approve


Nano-pass: remove empty records

As it turns out, the case where a struct is made of only ghost fields had previously never been exercised before. This is easily fixed with another nano-pass that performs a little bit of cleanup.

Reported by @R1kM


Alias case sensitivity

Sometimes aliases are added in upper (or mixed case), for example: OKA_dev.
It is not possible to use OKA_dev in taxi then, since apparently all aliases are handled in lower case in taxi. This might be very confusing for someone who looks up the alias in Zebra.

I could reproduce it. That's caused by Python's ConfigParser module that automatically lowercases options keys. We could either make aliases case insensitive, or preserve the case when saving them. I'm not sure which option is better.

Why not resolve that upfront and lover all aliases in Zebra already? I don't see an added value to allow uppercase in aliases

Task ticket Zebra side: https://jira.liip.ch/browse/ZBR-1785

Thanks, closing it on this side then.


Fix typo

Related Issue(s): None
Proposed Changes:

Just fixing a typo

PR Checklist:

[x] This PR is made against the dev branch (all proposed changes except releases should be against dev, not master).
[x] This PR has no breaking changes.
[x] I have added my changes to the CHANGELOG or a CHANGELOG entry is not required.
[ ] This PR affects the STAC API spec, and I have opened issue/PR #XXX to track the change.

I've also added another attempt to fix the schema publishing #1038