Add parallel processing for OpenAI completion models

Add parallel processing for OpenAI completion models
Implements https://github.com/openai/openai-cookbook/blob/main/examples/api_request_parallel_processor.py to speed up OpenAI API calls as per #1410

Makes requests concurrently, to maximize throughput
Throttles request and token usage, to stay under rate limits (max_tokens_per_minute, max_requests_per_minute)
Retries failed requests up to {max_attempts} times, to avoid missing data

Gives many X speedup for OpenAI models (dependent on users rate limits)
Uses a 1 token dummy request to get a user & model specific Token Per Minute (TPM) rate limit. Requests Per Minute (RPM) are not available programmatically for some reason, but I've raised this with openai. Both RPM and TPM can be overridden in the gen_kwargs using max_tokens_per_minute and max_requests_per_minute. Not sure if/where that should be documented?
Just implemened for openai chat completions since completions is now legacy, but easy to also do this for completions. Also just separated the local model call from the OpenAI model call as not sure people would want to do async/parallel for a local model?
Also, I follow the openai example and cache requests to jsonl file. I cache in temp and do clean up after, but please let me know if it would be better just doing it in memory (I'm not certain of the size of all of the evaluations).

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Peter Bevan seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

Thanks very much for this PR! I will try to review it as soon as I can.

Hi @pbevan1 ,
This PR looks quite good to me. Left some comments that you can easily address. Some few general thoughts that I had. @haileyschoelkopf please feel free to add in/chip in.

Can you add some unit tests for your core logic?
Your logic functions are big. Is it possible to chunk them down to smaller functions?

I believe adding tests should be a priority here.

Any plans on resolving conflicts, adding changes/updates and merging before the new release?

Bump - this would be a really useful feature that would massively speed up eval time

Is this still need? Since this is closed https://github.com/EleutherAI/lm-evaluation-harness/issues/1095

@baberabb -- are there some indicative speedup numbers via using batching and/or concurrency w/ #2008  that can be shared here before we close?

@baberabb -- are there some indicative speedup numbers via using batching and/or concurrency w/ #2008 that can be shared here before we close?

yeah. For example with defaults I get 0:23 for 40 requests to openai and 0.02 with num_concurrent=10. num_concurrent controls the number of parallel I/O connections (uses aiohttp under the hood).


How to specify which gpu to use?

If I have multiple GPUs, how can I specify which GPU to use individually?
Previously, I used 'device_map': 'sequential' with accelerate to control this. Now, with vllm_engine, is there a similar functionality available?"
exp. if i want to specify the gpu1 instead of gpu0,because they are not same type of card.i will write like this:
model_kwargs = {"torch_dtype": torch.float16, 'device_map': 'sequential'}

Then, I manually set the available memory of device0 to 0, with the purpose of using device1:
GPU_max_memory: {0: '0GiB', 1: '40GiB'}

Use CUDA_VISIBLE_DEVICES=0,1,2,3 python -m vllm.x.x.x. [parameters] to specify the gpus you want to use in a process level.

Thank you for the suggestion.
I am aware of this method, but due to my project's architecture, I need to be able to start my worker through a triggered request.
Using the "python" command directly in the terminal is not suitable for me. Nevertheless, I am delighted to receive your response. Thanks again.

In addition to @gesanqiu's method, you can also use Ray's placement group feature for this. Feel free to re-open the issue if you meet any issues or have any other suggestions!


Concurrent reads with LET subquery very slow

Hi, if i try to query 100 times in parallel this select:
SELECT *, $product as product FROM Category LET product = (SELECT expand($parent.$current.IN('Belong')[@class = Product]) LIMIT 10) ORDER BY (priority desc)

It looks like, that queries are executed one by one, because i receive first response in 500ms, second in 1000ms and last in 50s.
I have index on priority column.
Any work around for this?
Tested on:
OrientDB 2.1.5
4 cores
15GB of RAM

Hi @janjilek
this is exactly the case, LET query is executed once per record in Category.
Maybe you can restructure your query as follows:
SELECT *, in("Belong")[0-9][@class = Product] as product FROM Category ORDER BY (priority desc)

Let me know if it works better
Thanks
Luigi

Hi,
thank you, its much faster! Now i receive last request in 3 seconds. Can i order by vertex @rid somehow in the in("Belong")[0-9][@class = Product] query?
So its better to avoid LET completely in the select? I am using this style everywhere.
Regards
Jan

Sorry, so its not. It wasn't exactly the same query. I have change in("Belong")[0-9][@class = Product] to in("Belong")[@class = Product][0-9] and its againt 50s for the last one. So the bottleneck is definitelly filtering @class = Product.
Regards
Jan

Hi Jan,
Just to better understand, how many incoming edges to you have on each vertex?
LET operator in some cases is not very efficient, but simple traversal should be
Thanks
Luigi

Category vertex has cca 10k edges to product vertex. But it will grow in the future and I expect maybe 100k for each category. Maybe better idea is to create special edge HasProduct instead of in('Belong')[@class = Product] to avoid filtering.

Yes, definitely, query performance depends on how many vertices/edges you have to analyze, and in this case you are doing filtering on millions of vertices probably

@janjilek I'm closing this as it's not properly an issue. Maybe we can continue this discussion on StackOverflow if needed, there the community is very active and can give a contribution from real life experience.

Thank you!
Jan


Factor out the external call (to get the list of providers) to single method

Changes to api/views/CloudRecordView.py

Factor out the external call (to get the list of providers) to single method
Move enumerate(site_json['rows'] into try...except becaue if external call fails it throws an exception

Also adds new tests for

Successful POST
Unauthorized POST
Unauthenticated POST
External call fails during POST

changes made


Does not work on Sierra

New Issue Checklist

[x] Updated fastlane to the latest version

Issue Description
Every time I try to use it on Sierra I get an error when trying to build gem native extensions (rmagick).
🚨error output 🚨
[10:26:37]: Installing Ruby gem 'fastlane-plugin-ascii_art'...
Building native extensions.  This could take a while...
[10:26:53]: Error loading plugin 'fastlane-plugin-ascii_art': ERROR: Failed to build gem native extension.
current directory: /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/gems/2.2.0/gems/rmagick-2.15.4/ext/RMagick

/Users/fpg1503/.fastlane/bin/bundle/bin/ruby -r ./siteconf20170104-12438-1pma74d.rb extconf.rb
checking for /usr/bin/clang... yes
checking for Magick-config... yes
checking for outdated ImageMagick version (<= 6.4.9)... no
checking for Ruby version >= 1.8.5... yes
checking for stdint.h... *** extconf.rb failed ***
Could not create Makefile due to some reason, probably lack of necessary
libraries and/or headers.  Check the mkmf.log file for more details.  You may
need configuration options.
Provided configuration options:
--with-opt-dir
--without-opt-dir
--with-opt-include
--without-opt-include=${opt-dir}/include
--with-opt-lib
--without-opt-lib=${opt-dir}/lib
--with-make-prog
--without-make-prog
--srcdir=.
--curdir
--ruby=/Users/fpg1503/.fastlane/bin/bundle/bin/$(RUBY_BASE_NAME)
/Users/fpg1503/.fastlane/bin/bundle/lib/ruby/2.2.0/mkmf.rb:456:in try_do': The compiler failed to generate an executable file. (RuntimeError) You have to install development tools first. 	from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/2.2.0/mkmf.rb:587:in try_cpp'
from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/2.2.0/mkmf.rb:1060:in block in have_header' 	from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/2.2.0/mkmf.rb:911:in block in checking_for'
from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/2.2.0/mkmf.rb:351:in block (2 levels) in postpone' 	from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/2.2.0/mkmf.rb:321:in open'
from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/2.2.0/mkmf.rb:351:in block in postpone' 	from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/2.2.0/mkmf.rb:321:in open'
from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/2.2.0/mkmf.rb:347:in postpone' 	from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/2.2.0/mkmf.rb:910:in checking_for'
from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/2.2.0/mkmf.rb:1059:in have_header' 	from extconf.rb:38:in configure_headers'
from extconf.rb:18:in initialize' 	from extconf.rb:517:in new'
from extconf.rb:517:in `'
To see why this extension failed to compile, please check the mkmf.log which can be found here:
/Users/fpg1503/.fastlane/bin/bundle/lib/ruby/gems/2.2.0/extensions/x86_64-darwin-15/2.2.0-static/rmagick-2.15.4/mkmf.log
extconf failed, exit code 1
Gem files will remain installed in /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/gems/2.2.0/gems/rmagick-2.15.4 for inspection.
Results logged to /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/gems/2.2.0/extensions/x86_64-darwin-15/2.2.0-static/rmagick-2.15.4/gem_make.out
+---------------------------+-----------+---------------------------+
|                           Used plugins                            |
+---------------------------+-----------+---------------------------+
| Plugin                    | Version   | Action                    |
+---------------------------+-----------+---------------------------+
| fastlane-plugin-cryptex   | 0.1.3     | cryptex                   |
|                           |           | cryptex_generate_keystore |
| fastlane-plugin-ascii_art | undefined | No actions found          |
+---------------------------+-----------+---------------------------+
[10:26:53]: You require a gem, if this is a third party gem, please use fastlane_require 'digest/md5' to ensure the gem is installed locally
[10:26:53]: -------------------------------------------------
[10:26:53]: --- Step: Verifying required fastlane version ---
[10:26:53]: -------------------------------------------------
[10:26:53]: Your fastlane version 2.4.0 matches the minimum requirement of 1.109.0  ✅
[10:26:53]: ------------------------------
[10:26:53]: --- Step: default_platform ---
[10:26:53]: ------------------------------
[10:26:53]: Driving the lane 'logo' 🚀
[10:26:53]: -------------------------------------
[10:26:53]: --- Step: ensure_git_status_clean ---
[10:26:53]: -------------------------------------
[10:26:54]: Git status is clean, all good! 💪
[10:26:54]: -------------------
[10:26:54]: --- Step: slack ---
[10:26:54]: -------------------
[10:26:54]: Successfully sent Slack notification
[10:26:54]: ----------------------------
[10:26:54]: --- Step: reset_git_repo ---
[10:26:54]: ----------------------------
[10:26:54]: $ git reset --hard HEAD
[10:26:54]: ▸ HEAD is now at 0479046 Add ascii logo
[10:26:54]: Git repo was reset and cleaned back to a pristine state.
+-----------------------------+---------+
|             Lane Context              |
+-----------------------------+---------+
| DEFAULT_PLATFORM            | android |
| PLATFORM_NAME               |         |
| LANE_NAME                   | logo    |
| GIT_REPO_WAS_CLEAN_ON_START | true    |
+-----------------------------+---------+
[10:26:54]: Plugin 'ascii_art' was not properly loaded, make sure to follow the plugin docs for troubleshooting: https://github.com/fastlane/fastlane/blob/master/fastlane/docs/PluginsTroubleshooting.md
+------+-------------------------------------+-------------+
|                     fastlane summary                     |
+------+-------------------------------------+-------------+
| Step | Action                              | Time (in s) |
+------+-------------------------------------+-------------+
| 1    | Verifying required fastlane version | 0           |
| 2    | default_platform                    | 0           |
| 3    | ensure_git_status_clean             | 0           |
| 4    | slack                               | 0           |
| 5    | reset_git_repo                      | 0           |
+------+-------------------------------------+-------------+
Looking for related GitHub issues on fastlane/fastlane...
Found no similar issues. To create a new issue, please visit:
https://github.com/fastlane/fastlane/issues/new
Run fastlane env to append the fastlane environment to your issue
/Users/fpg1503/.fastlane/bin/bundle/lib/ruby/site_ruby/2.2.0/rubygems/version.rb:207:in initialize': Malformed version number string undefined (ArgumentError) 	from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/site_ruby/2.2.0/rubygems/version.rb:199:in new'
from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/site_ruby/2.2.0/rubygems/version.rb:199:in new' 	from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/gems/2.2.0/gems/fastlane-2.4.0/fastlane/lib/fastlane/plugins/plugin_update_manager.rb:29:in block in show_update_status'
from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/gems/2.2.0/gems/fastlane-2.4.0/fastlane/lib/fastlane/plugins/plugin_update_manager.rb:26:in each' 	from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/gems/2.2.0/gems/fastlane-2.4.0/fastlane/lib/fastlane/plugins/plugin_update_manager.rb:26:in show_update_status'
from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/gems/2.2.0/gems/fastlane-2.4.0/fastlane/lib/fastlane/commands_generator.rb:39:in ensure in start' 	from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/gems/2.2.0/gems/fastlane-2.4.0/fastlane/lib/fastlane/commands_generator.rb:46:in start'
from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/gems/2.2.0/gems/fastlane-2.4.0/fastlane/lib/fastlane/cli_tools_distributor.rb:59:in take_off' 	from /Users/fpg1503/.fastlane/bin/bundle/lib/ruby/gems/2.2.0/gems/fastlane-2.4.0/bin/fastlane:5:in <top (required)>'
from /Users/fpg1503/.fastlane/bin/bundle/bin/fastlane:22:in load' 	from /Users/fpg1503/.fastlane/bin/bundle/bin/fastlane:22:in '

Environment
✅ fastlane environment ✅
Stack

Key
Value

OS
10.12.2

Ruby
2.2.4

Bundler?
false

Git
git version 2.9.3 (Apple Git-75)

Installation Source
~/.fastlane/bin/bundle/bin/fastlane

Host
Mac OS X 10.12.2 (16C67)

Ruby Lib Dir
~/.fastlane/bin/bundle/lib

OpenSSL Version
OpenSSL 1.0.2g  1 Mar 2016

Is contained
true

Xcode Path
/Applications/Xcode.app/Contents/Developer/

Xcode Version
8.1

System Locale

Variable
Value

LANG
en_US.UTF-8
✅

LC_ALL
en_US.UTF-8
✅

LANGUAGE
en_US.UTF-8
✅

fastlane files:
`./fastlane/Fastfile`
fastlane_version "1.109.0"
default_platform :android

require 'digest/md5'

def ascii_logo
  md5 =<EMAIL_ADDRESS>  gravatar = "https://www.gravatar.com/avatar/#{md5}?s=400"
  ascii_art(image_path: gravatar)
end

lane :logo do
  ascii_logo
end

No Appfile found
fastlane gems

Gem
Version
Update-Status

fastlane
2.4.0
✅ Up-To-Date

Loaded fastlane plugins:

Plugin
Version
Update-Status

fastlane-plugin-cryptex
0.1.3
✅ Up-To-Date

fastlane-plugin-ascii_art
undefined
💥 Check failed

Loaded gems

Gem
Version

CFPropertyList
2.3.4

activesupport
<IP_ADDRESS>

addressable
2.5.0

babosa
1.0.2

bigdecimal
1.2.6

bundler
1.13.6

claide
1.0.1

colored
1.2

commander
4.4.2

domain_name
0.5.20161129

dotenv
2.1.1

excon
0.54.0

faraday
0.10.0

faraday-cookie_jar
0.0.6

faraday_middleware
0.10.1

fastimage
2.0.1

fastlane-plugin-cryptex
0.1.3

gh_inspector
1.0.2

google-api-client
0.9.20

googleauth
0.5.1

highline
1.7.8

http-cookie
1.0.3

httpclient
2.8.3

hurley
0.2

i18n
0.7.0

io-console
0.4.3

json
1.8.1

jwt
1.5.6

libxml-ruby
2.9.0

little-plugger
1.1.4

logging
2.1.0

memoist
0.15.0

mime-types
3.1

mime-types-data
3.2016.0521

mini_magick
4.5.1

minitest
5.4.3

multi_json
1.12.1

multi_xml
0.6.0

multipart-post
2.0.0

nanaimo
0.2.3

nokogiri
1.5.6

os
0.9.6

plist
3.2.0

power_assert
0.2.2

psych
2.0.8

public_suffix
2.0.4

rake
10.4.2

rdoc
4.2.0

representable
2.3.0

retriable
2.1.0

rouge
1.11.1

rubygems-update
2.5.2

rubyzip
1.2.0

security
0.1.3

signet
0.7.3

slack-notifier
1.5.1

sqlite3
1.3.12

terminal-notifier
1.7.1

terminal-table
1.7.3

test-unit
3.0.8

thread_safe
0.3.5

tzinfo
1.2.2

uber
0.0.15

unf
0.1.4

unf_ext
<IP_ADDRESS>

unicode-display_width
1.1.2

word_wrap
1.0.0

xcodeproj
1.4.2

xcpretty
0.2.4

xcpretty-travis-formatter
0.0.4

generated on: 2017-01-04

(I've removed irrelevant portions of my Fastfile)

Oh seems like this plugin might not work with the pre-packaged fastlane 😢

The alternative is to install fastlane using system ruby or bundler 👍

If I try to use bundler it says that the plugin gem is missing:
[12:05:34]: Missing gem 'fastlane-plugin-ascii_art', please add the following to your local Gemfile:
[12:05:34]:
[12:05:34]: ▸ gem "fastlane-plugin-ascii_art"
[12:05:34]:
[12:05:34]: Error loading plugin 'fastlane-plugin-ascii_art': Add 'gem "fastlane-plugin-ascii_art"' to your Gemfile and restart fastlane

I ran bundle exec fastlane logo.
Gemfile
# Autogenerated by fastlane
#
# Ensure this file is checked in to source control!

source "https://rubygems.org"

gem 'fastlane'

plugins_path = File.join(File.dirname(__FILE__), 'fastlane', 'Pluginfile')
eval(File.read(plugins_path), binding) if File.exist?(plugins_path)

Pluginfile
# Autogenerated by fastlane
#
# Ensure this file is checked in to source control!

gem 'fastlane-plugin-cryptex'
gem 'fastlane-plugin-ascii_art'

✅ fastlane environment ✅
Stack

Key
Value

OS
10.12.2

Ruby
2.2.4

Bundler?
true

Git
git version 2.9.3 (Apple Git-75)

Installation Source
~/.fastlane/bin/bundle/bin/fastlane

Host
Mac OS X 10.12.2 (16C67)

Ruby Lib Dir
~/.fastlane/bin/bundle/lib

OpenSSL Version
OpenSSL 1.0.2g  1 Mar 2016

Is contained
true

Xcode Path
/Applications/Xcode.app/Contents/Developer/

Xcode Version
8.1

System Locale

Variable
Value

LANG
en_US.UTF-8
✅

LC_ALL
en_US.UTF-8
✅

LANGUAGE
en_US.UTF-8
✅

fastlane gems

Gem
Version
Update-Status

fastlane
2.4.0
✅ Up-To-Date

Loaded fastlane plugins:

Plugin
Version
Update-Status

fastlane-plugin-cryptex
0.1.3
✅ Up-To-Date

fastlane-plugin-ascii_art
undefined
💥 Check failed

Loaded gems

Gem
Version

CFPropertyList
2.3.4

activesupport
<IP_ADDRESS>

addressable
2.5.0

babosa
1.0.2

bigdecimal
1.2.6

bundler
1.13.6

claide
1.0.1

colored
1.2

commander
4.4.2

domain_name
0.5.20161129

dotenv
2.1.1

excon
0.54.0

faraday
0.10.0

faraday-cookie_jar
0.0.6

faraday_middleware
0.10.1

fastimage
2.0.1

fastlane-plugin-cryptex
0.1.3

gh_inspector
1.0.2

google-api-client
0.9.20

googleauth
0.5.1

highline
1.7.8

http-cookie
1.0.3

httpclient
2.8.3

hurley
0.2

i18n
0.7.0

io-console
0.4.3

json
1.8.1

jwt
1.5.6

libxml-ruby
2.9.0

little-plugger
1.1.4

logging
2.1.0

memoist
0.15.0

mime-types
3.1

mime-types-data
3.2016.0521

mini_magick
4.5.1

minitest
5.4.3

multi_json
1.12.1

multi_xml
0.6.0

multipart-post
2.0.0

nanaimo
0.2.3

nokogiri
1.5.6

os
0.9.6

plist
3.2.0

power_assert
0.2.2

psych
2.0.8

public_suffix
2.0.4

rake
10.4.2

rdoc
4.2.0

representable
2.3.0

retriable
2.1.0

rouge
1.11.1

rubygems-update
2.5.2

rubyzip
1.2.0

security
0.1.3

signet
0.7.3

slack-notifier
1.5.1

sqlite3
1.3.12

terminal-notifier
1.7.1

terminal-table
1.7.3

test-unit
3.0.8

thread_safe
0.3.5

tzinfo
1.2.2

uber
0.0.15

unf
0.1.4

unf_ext
<IP_ADDRESS>

unicode-display_width
1.1.2

word_wrap
1.0.0

xcodeproj
1.4.2

xcpretty
0.2.4

xcpretty-travis-formatter
0.0.4

generated on: 2017-01-04

Did you run bundle update?

Yes 😢

The pre-packaged version of fastlane is in my path, should I remove it?

Yes, you'll have to remove it

Yeah, let's close this for now 👍

Thanks

Hi @fpg1503, could you outline exactly what you did to resolve this issue?
I ran:
bundle exec fastlane add_plugin ascii_art
and got the same error as you were getting.
Then I removed fastlane from my PATH and ran
bundle exec fastlane add_plugin ascii_art
and I was still getting the same error. (I'm on High Sierra)
Do you recall anything else that you had to do?
Thanks.


Leverage index on queries

Right now when we query we iterate over the entire index.
This makes a query an O(N) operation, and renders the index pointless. We should instead leverage the sorted nature during queries to minimize the number of granules we have to look at.
Ideally we'd also do this on insert as well.

I kind of have the feeling that we need to implement our own ordered list in order for us to perform the type of queries we want on it. Before we do that though, we should have a closer look at the google btree capabilities again.


[SPARK-46545][INFRA] Pin lxml==4.9.4

What changes were proposed in this pull request?
Pin 'lxml==4.9.4'
Why are the changes needed?
it seems the newly released lxml 5.0.0 breaks the CI (the Install Python packages (Python 3.9) step for Spark SQL tests)
Collecting lxml (from unittest-xml-reporting)
  Downloading lxml-5.0.0.tar.gz (3.8 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.8/3.8 MB 17.4 MB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'error'
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [4 lines of output]
      <string>:67: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
      Building lxml version 5.0.0.
      Building without Cython.
      Error: Please make sure the libxml2 and libxslt development packages are installed.
      [end of output]

in the latest successful run, the version is 4.9.4:
Package                  Version
------------------------ ------------
googleapis-common-protos 1.62.0
grpcio                   1.59.3
grpcio-status            1.59.3
lxml                     4.9.4
numpy                    1.26.2
pandas                   2.1.4
pip                      23.0.1
protobuf                 4.25.1
pyarrow                  14.0.2
python-dateutil          2.8.2
pytz                     2023.3.post1
scipy                    1.11.4
setuptools               58.1.0
six                      1.16.0
tzdata                   2023.3
unittest-xml-reporting   3.2.0

unittest-xml-reporting requires lxml but without specified version
name                    summary
----------------------  ------------------------------------------------------------------------------------------------
unittest-xml-reporting  unittest-based test runner with Ant/JUnit like XML reporting.
└── lxml                Powerful and Pythonic XML processing library combining libxml2/libxslt with the ElementTree API.

Does this PR introduce any user-facing change?
no, infra only
How was this patch tested?
ci
Was this patch authored or co-authored using generative AI tooling?
no

let's wait for CI: https://github.com/zhengruifeng/spark/actions/runs/7361000751

the Install Python packages (Python 3.9) step in SQL - Slow tests now run successfully

cc @dongjoon-hyun @LuciferYang

Merged to master.

thanks @dongjoon-hyun

late LGTM


Spacers of homologous recombination primer design

Respect to what does it make sense to define them?

With respect to the insert, so that if the insert is inverted it goes the other way around
With respect to the homology region (as is) so that they are always read in the same direction

My two cents would be to define them with respect to the insert:

Ontologically, the spacer is also inserted.
Practically speaking, you can perform a PCR and obtain product that has insert + spacer + recombination tail, and stop it there.
Mostly, the applications that come to my mind of adding a spacer, it is an addition to the insert (e.g. when adding a GFP construct from a plasmid to a random genetic locus, if you want to add a small tag at the C-ter end, you can do it with either of the recombination tails, but always with the C-ter-annealing primer).

I may be missing something on how the primer design works, so let me know if what I said makes sense.

Thanks for the thought @dgruano
I agree that it seems to make sense in this case, but for the gibson assembly it only makes sense to define the spacers with respect to the final assembly (regardless of whether each fragment is oriented in either direction), so the spacer would have a different meaning in each case

Ha! It's a tricky call when you introduce the Gibson Assembly indeed...


[RFC - WIP]Add get linked endpoint

This is a WIP branch, only opened for obtaining some feedback on whether I am approaching this problem correctly. The code requires refactoring.
We need an endpoint to get a list of the content which has a link of the given type to the given content-id.  This is needed to support the https://trello.com/c/DLakGcP0/351-add-a-way-to-monitor-that-the-taggings-in-panopticon-and-content-store-are-the-same story.
It is the publisher-get-linked endpoint described in the RFC.
What the output of the endpoint looks like:

Hi @jackscotti.
Small details aside, this looks like a good approach to me.  The only significant thing I'd change is the naming.  The things in that table aren't really linked items, they represent the links between items.
I would also question whether you need that table at all.  From the ticket it looks like this won't be an especially heavy-use endpoint, and we already have a table which contains the links between content items.  You could use postgresql's JSON queries to achieve the same thing.

This could do with some integration level tests that cover the external behaviour of this feature.

Thank you all for the great feedback.
@elliotcm this is an example of the simplest query that does what is required by the endpoint:
SELECT * FROM (SELECT content_id,links->>'organisations' link_type FROM link_sets) linkedItem where linkedItem.link_type LIKE '%96ae61d6-c2a1-48cb-8e67-da9d105ae381%’

It pulls all the items out of links as a string and then uses the '%' wildcards to look whether the wanted content id is in the string containing all the links. It's not really elegant and I spent more than a day to write it. :disappointed:
From the chat I've had with @danielroseman it seemed that your team wanted to create this table anyway. What do you think is the better approach?

@jackscotti There's a bunch of JSON support functions that would probably make it easier, but if we need the table anyway let's go ahead with it.

@elliotcm from what I've understood browsing the Internet, there is a bunch of support for JSON only from Postgres 9.3. Anyway, I'll ask the team.

@jackscotti yes, that's correct.  All our apps are on the 9.3 cluster now.

@elliotcm got confused, I meant to say 9.4.

To echo some of what's already been said – we already have a table that stores this information. We should probably use that for serving this request.
I think that if we want to start querying our data as opposed to just plumbing it through to the content store, we should be thinking about persisting it in a structure that's conducive to this. I think it would be better if we had a links table that is many-to-one with content_items, as opposed to link_sets.
This takes the responsibility of handling the multiplicity of this relation out of the application and captures it semantically in the database. That's kind of how relational databases are intended to be used.

We were just discussing about the very same thing and we all seem to agree on it. Tomorrow I'll pop over and talk to your team to have a further discussion.

Closing this PR. We agreed this work will be split in 3 different PRs:
First:

add a ContentItemLink table that is the derived representation of the links in LinkSet, AND
populate ContentItemLink

Second:

modify the logic of the application to use ContentItemLinkinstead of LinkSet, AND
delete LinkSet

Third:

Add the GetLinked endpoint

EDIT. Further update:
LinkSet table, would keep to exist, but would drop its link and version columns. link column will be represented by the new Link table and the version column can be dropped because it's redundant.
The reason of this change is that we want to keep versioning set of links and not links singularly.
First:

add a ContentItemLink table that is the derived representation of the links in LinkSet, AND
populate ContentItemLink table

Second:

modify the logic of the application to use ContentItemLinkinstead of LinkSet, AND
drop links and version form the LinkSet table

Third:

Add the GetLinked endpoint

I think we should have:
ContentItem <---------------------|
        | 1                               Version
        | 1                                    |
  LinkSet  <-------------------------|
        | 1
        | *
     Link

I think that we should think of these tables/models as the domain model for the application. When they're sent downstream to other applications, they are presented to adhere to the contract of the service.

@tuzz Is that the same schema @elliotcm told us about?

Yes – I think so. My comment was intended to clarify to ensure we're on the same page.

:+1:

Cool! We are

Hey @jackscotti – we had a quick play around with writing the query we think you need. This is untested, but it might help:
select l.source
from link_sets ls
join links l on
l.link_set_id = ls.id and
ls.content_id = "some-content-id" and
l.type = "organisations"

In Rails, we think this would translate to:
link_set = LinkSet.find_by!(content_id: "some-content-id")
content_ids = link_set.links.where(type: "organisations").pluck(:source)

Shout if you have any questions.
Thanks


Error in example code for I2C LCD

Traceback (most recent call last):
File "", line 9, in
File "LCD_I2C.py", line 57, in init
File "LCD_I2C.py", line 107, in _command
OSError: [Errno 5] EIO

Which lcd modulw are you using ?
This library is for
https://www.cytron.io/p-3v3-i2c-and-spi-1602-serial-character-lcd?tracking=b-py
You may look the library documentation here
https://github.com/Bhavithiran97/LCM1602-14_LCD_Library


small cleanups and fixes

pkg/true_git/ls_tree/result.go:69:4: SA4006: this value of `err` is never used (staticcheck)
pkg/build/conveyor.go:1235:16: printf: Errorf format %s reads arg #4, but call has 3 args (govet)
pkg/deploy/lock_manager/lock_manager.go:39:58: SA1012: do not pass a nil Context, even if a function permits it; pass context.TODO if you are unsure about which Context to use (staticcheck)
pkg/path_matcher/git_mapping.go:93:28: unslice: could simplify f.includePaths[:] to f.includePaths (gocritic)
pkg/path_matcher/git_mapping.go:94:28: unslice: could simplify f.excludePaths[:] to f.excludePaths (gocritic)

Needs rebase onto latest master.

Needs rebase onto latest master.


Add a Zoom Clone.

Feature Request

Want to add a Zoom Clone.
Don't know how it will be but I will try it.

i am a gssoc 22 participant ,can i add zoom clone, please assign me in this


Test scripts for testing

we are unable to find the test scripts used to do the following tests
o	Functional testing
o	Performance testing
o	SOA testing
o	Mobile testing
Please provide the WSDL files to do SOA testing also.
If the test scripts are not yet open sourced, please mail it to the id<EMAIL_ADDRESS>

Functional testing: @madhucr
Perf testing: @mathewjpallan
SOA testing: @madhucr
Mobile testing: @mathewjpallan

hi  @madhucr @mathewjpallan , Can you please share the details at the earliest .
@kochhar
If the test scripts are not yet open sourced, please mail it to the id<EMAIL_ADDRESS>

Hi @arjun1092, Sunbird test automation is WIP. If you'd like to contribute to this effort, you could start with API test automation. Please let me know and I will share the present API automation backlog with you.
Sunbird runs REST APIs not SOAP, so there isn't a WSDL available. Instead, you can find the REST documentation linked from the sunbird docs site: http://www.sunbird.org/apis/ From the API documentation pages, you can download the OpenAPI specification for each API group.

@kochhar : can you please shed some light on the tools used for the different tests.

Presently, we're using Postman collections for writing API test cases. The
test case runs can be automated via Postman's console test runner: Newman.
If you would like to use any tools particular tools which are well suited
to REST API testing (and which can support OpenAPI spec or Swagger spec),
please do share your suggestions. We're at an early stage of implementation
and can consider alternatives.
Thanks!
On Thu, Nov 9, 2017 at 12:55 PM arjun u<EMAIL_ADDRESS>wrote:

@kochhar https://github.com/kochhar : can you please shed some light on
the tools used for the different tests.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/project-sunbird/sunbird-commons/issues/102#issuecomment-343069300,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAGVqtVHbyV-kjUvg0hwy1Ubo_AseyiQks5s0qkDgaJpZM4QUeJU
.

@kochhar  why not soapui with swagger connector.?

Please share some links to docs which explain how soapui can be scripted
via bash for test automation. I will share with the team and organise the
feedback on its suitability.
On 09-Nov-2017 17:05, "arjun u"<EMAIL_ADDRESS>wrote:

@kochhar https://github.com/kochhar why not soapui with swagger
connector.?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/project-sunbird/sunbird-commons/issues/102#issuecomment-343128521,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAGVqvOc1wkdpcqx74scyb7yQg0Scv3pks5s0uN3gaJpZM4QUeJU
.

@kochhar : Do you want links which describes : how to execute Soapui , scripts  via CLI ?

Hi @arjun1092, thanks a lot for the links. As of now, we don't understand the context around using SoapUI -- what are the problems with the alternatives and what kind of benefits would result from using SoapUI?
It would be useful for to create a one-page document which can help everyone involved understand the proposal you are making in detail. Here's an example of a document which was useful when deciding the authentication server to use in Sunbird.
https://docs.google.com/document/d/1fGWBvwRiIhjSV0O68w-tARU9AYIKEUlD5l0nQArUdsg/edit#heading=h.jn0enjryg2
Thanks a lot, look forward to reading the detailed proposal.

@kochhar  : I can go ahead with Postman.(I was yet to explore pm.* API when I posted this).
Please shed some light on tools used for functional @madhucr ,performance @mathewjpallan  and mobile testing @mathewjpallan )

@arjun1092 sure, please go ahead with Postman. If you'd like to automate running the tests, Postman includes a console-based test runner called newman. This blog explains in more detail how to use newman to automate API tests from your build system.
http://blog.getpostman.com/2015/09/03/how-to-write-powerful-automated-api-tests-with-postman-newman-and-jenkins/
As before, the API spec can be downloaded from the Sunbird API documentation hub: http://www.sunbird.org/apis/

@kochhar  I need information for the tools used for the rest as well for the Bodhi project .  Please let me know those details ate the earliest.
What is the current status for SOA testing? Any specific pipeline or something is  already defined in jenkins ?
Any specific syntaxes or conventions  to be followed while writing test scripts.?

hi @kochhar , Can you please provide the inputs for the query above.
I need information for the tools used for the rest as well for the Bodhi project . Please let me know those details at the earliest.
What is the current status for SOA testing? Any specific pipeline or something is already defined in jenkins ?
Any specific syntax's or conventions to be followed while writing test scripts.?

@arjun1092 the current tool used is postman. the API specification for postman can be downloaded from the sunbird.org/api_docs site. at present SOA testing is WIP. No pipelines have been defined.
When writing test-cases, please use Javascript test cases in Postman.
Please ensure that environment details are abstracted into a postman environment so those details do not get introduced into the codebase.
For Javascript tests, please follow the Standard JS guidelines.


New version: Mozilla.Thunderbird version 115.0.1

Pull request has been created with WinGet Automation :rocket:
Microsoft Reviewers: codeflow:open?pullrequest=https://github.com/microsoft/winget-pkgs/pull/115186&drop=dogfoodAlpha

@wingetbot run

Manifest Error: Duplicate installer entry found.

@vedantmgoyal2009,
It looks like this package is supposed to have numerous localization installers, but only the English installers are used.


[TS-SDK] Add enums in getNormalizedMoveModule

Description
Adds enums to the NormalizedMoveModule for TS-SDK.
Test plan
How did you test the new or updated feature?

Release notes
Check each box that your changes affect. If none of the boxes relate to your changes, release notes aren't required.
For each box you select, include information after the relevant heading that describes the impact of your changes that a user might notice and any actions they must take to implement updates.

[ ] Protocol:
[ ] Nodes (Validators and Full nodes):
[ ] Indexer:
[x] JSON-RPC: https://github.com/MystenLabs/sui/pull/20231
[ ] GraphQL:
[ ] CLI:
[ ] Rust SDK:
[ ] REST API:
[x] TS SDK: Fixes an issue where enum types were not included in the output of getNormalizedMoveModule and getNormalizedMoveModuleForPackage

related issue:

https://github.com/MystenLabs/sui/issues/20205

It looks like this creates an error in the graphql-transport pacakge

Hi @hayes-mysten , just want ask when will client be updated? We're waiting for the enum support update. 😄

Ran into some issues getting this updated on this branch, I've opened up a new PR for this here: https://github.com/MystenLabs/sui/pull/20684


Babel 6 update

Update dependencies, babelrc, test command.
Update babel-eslint to 5.0.0-beta6, it supported babel 6.

Should we use babel-preset-react-hmre here?
https://github.com/gaearon/react-transform-boilerplate/commit/d131c2ba854d753a36275b12849312b6200ef309

You're right! It's done. :)

Thanks!


setInterval minimum delay

The documentation for setInterval's delay argument reads, in part,

If this argument is less than 10, a value of 10 is used.

Is this still the case? WHATWG's spec seems to limit the delay to 4 ms:

If the currently running task is a task that was created by this algorithm, then let nesting level be the task's timer nesting level. Otherwise, let nesting level be zero.

Note: The task's timer nesting level is used both for nested calls to setTimeout(), and for the repeating timers created by setInterval(). (Or, indeed, for any combination of the two.) In other words, it represents nested invocations of this algorithm, not of a particular method.

If timeout is less than 0, then set timeout to 0.

If nesting level is greater than 5, and timeout is less than 4, then set timeout to 4.

Acceptance criteria

[x] Necessary changes have been made, if warranted following research

https://wiki.developer.mozilla.org/en-US/docs/Web/API/WindowOrWorkerGlobalScope/setInterval#Delay_restrictions


Issue 679

Fix for issue #679

I included within the FileOperationChecker to report an error because there are multiple ways to fail a file operation. The caller would not know exactly why the operation failed if he only receives a false return value.
Moreover, I cannot think of a case where a file operation is about to fail, and the caller does NOT want to inform the user.
Thoughts? @clyne @sgpearse

On Apr 20, 2018, at 12:26 PM, Samuel Li<EMAIL_ADDRESS>wrote:
I included within the FileOperationChecker to report an error because there are multiple ways to fail a file operation. The caller would not know exactly why the operation failed if he only receives a false return value.

You can have the checker method return an error string or status flag as an argument.

Moreover, I cannot think of a case where a file operation is about to fail, and the caller does NOT want to inform the user.

Sure. You may want to use utilities to explore multiple options. Is there a readable file of some sort in the current working directory? No? How about in the home directory?
In general things that return status are more useful if they don’t enforce an error reporting mechanism that may not be wanted in all use cases. That’s the model that we use throughout the codebase.
jc

Thoughts? @clyne @sgpearse
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

John Clyne
National Center for Atmospheric Research
303.497.1236 (w),<PHONE_NUMBER> (c)
<EMAIL_ADDRESS>

John, that is a good point. I've changed the behavior of FileOperationChecker so that it 1) does not pop up a window, and 2) it records the latest error message.

Should be good now.

Should be good now.


Fix array index out of range when just - is passed

Great catch, thanks for this! :sparkles: I made a minor style tweak and added a check for -- to the test before merging.


Elastalert not alerting

I am trying to utilize a simple rule using Elastalert, and it seems to not be functioning properly. My rule is:
    # Elasticsearch host
    es_host: elastic search

    # The elastic search port
    es_port: 9200

    name: dzd_count_zero

    type: any

    index: logstash-*

    filter:
    - term:
        project: "drop_zone_double"
    - terms:
        name: ["s3_count", "dzd_nas_pcount"]

    alert:
    - "email"

    email:
    -<EMAIL_ADDRESS>

and when I put debug on i get:
    elastalert:Ran dzd_count_zero from 2016-03-02 13:59 UTC to 2016-03-02 17:59 UTC: 16 query hits, 0 matches, 0 alerts sent
If the rule is 'any' then any query hits should be alerted on, but as you can see it is not. Any ideas?

This is the entire rule? I've never seen this behavior before.
What version are you using?

Yeah thats the whole rule. I am using the most recent version(cloning repo). My python version is Anaconda2-2.4.1, and my run command is:
python elastalert/elastalert.py --debug --es_debug --config my_config/elastalert_conf.yaml --es_debug_trace ./es.log
ran from the top level of the repo after installing setup.py and requirements.txt.
my config is:
# Any .yaml file will be loaded as a rule
rules_folder: my_rules

# How often ElastAlert will query elastic search
# The unit can be anything from weeks to seconds
run_every:
  minutes: 1

# ElastAlert will buffer results from the most recent
# period of time, in case some log sources are not in real time
buffer_time:
  hours: 4

# The elasticsearch hostname for metadata write back
# Note that every rule can have it's own elastic search host
es_host: elasticsearch

# The elastic search port
es_port: 9200

# elastalert-create-index to set a mapping
writeback_index: elastalert_status

# If an alert fails for some reason, ElastAlert will retry
# sending the alert until this time period has elapsed
alert_time_limit:
  days: 2

Issue was somehow tied to Anaconda2-2.5.0, still not entirely sure exactly what it was, but once I changed to an older version it worked.


(PUP-7330) Ensure that lookup CLI initializes loaders

Under some very rare circumstances, such as when the running the lookup
CLI command and the only available data provider for Hiera was a custom
backend written in Ruby, the Pcore would not be initialized by the
compiler since no loader was ever requested. This in turn, resulted in
that the Puppet::LookupKey and Puppet::LookupValue types never got
initialized.
This commit changes the compiler so that it performs the task of
initializing loaders and Pcore during its own initialization instead of
performing it lazily when the loaders are first requested.
The change in behavior broke a couple of tests that made assumptions on
the deferred loader initialization. This commit fixes those tests as
well.
The problem was triggered by commit 12b8ab94cd75c3db9feb858c4eccf61d9b6940db

Superseeds PR-5741

@thallgren since this PR is part of the necessary changes for PUP-7330, could you add that to the git commit summary?

Agree with @joshcooper - this should not be a (maint) ticket. Either target PUP-7330 (probably best), or a separate ticket.

Commit amended to target PUP-7330.

CLA signed by all contributors.

@joshcooper , @hlindberg , I found a better solution. It required some changes of tests that made assumptions about internal behavior but those were assumptions that they really should not rely on in the first place.

There was (at least once upon a time) a very good reason for the loaders to be initialized lazily. See PUP-2176 where this was introduced

(PUP-2176) Use lazy initialization of context in compiler
This makes the compiler initialize its context lazily wrt. the
injector and loader when using the future branch of the logic.
This is required because loaders and injector would otherwise
need to be initialized twice; once for the initial import and
a second time when doing the compilation. Now the values are retained.
The initial problem was that compiler's initial import is triggered
before loaders and injector was initialized (from initvars). This is
required for using logic from the loader subsystem. Specifically for
being able to define a function on the command line using puppet apply.

Maybe other things have now changed so this is no longer needed.

I looked at the concern I raised above - the branches of the logic that caused the problems fixed by PUP-2176 no longer exist for loaders.

I think this is good to merge now. The comment @joshcooper made has been addressed (targeting PUP-7330). My concern that the lazy init could still be of value, or possible affect performance was unfounded. Merging.

Thanks @thallgren and @hlindberg, changes look good and cleaner too.


comments about separate WAL devs in osds.yml.sample

ceph-ansible 4.0.5
there's a bunch of historical comments in group_vars/osds.yaml.sample, telling people about special options such as
bluestore_wal_devices: []
and fancyschmancy lvm_volume layouts.
Thing is though... these days, they are almost completely unneccesary.
ceph nautilus in bluestore mode, at least, lets you just give all the devices to ceph-volume -batch...
and then it will figure out, "oh, this is an SSD. I'm going to use it just for caching,etc".
its probably good to leave in a comment about, "if you REALLY want to hand tune things, you can do it this way", but I would suggestion the top level default commented bit should encourage users to just dump all their devs in the devices: array.
I can submit another comment pull request if you like.  but mine will be another very short one at the top, rather than  a full restructuring. figure I'd leave that kind of stuff to you guys.

except there also needs to be some missing piece of information added.
It worked great for me... ONE TIME.
but now any time I try to run it I get this error:
``fatal: [HOSTNAME]: FAILED! => changed=false
cmd:

ceph-volume
--cluster
ceph
lvm
batch
--bluestore
--yes
/dev/sda
/dev/sdb
/dev/sdd
/dev/sde
/dev/sdf
/dev/sdg
/dev/sdh
/dev/sdi
/dev/sdj
/dev/sdk
--report
--format=json
msg: non-zero return code
rc: 1
stderr: --> Aborting because strategy changed from bluestore.MixedType to bluestore.SingleType after filtering
stderr_lines:
stdout: ''
stdout_lines:
``

could you share your ceph.conf ?

my ceph.conf? huh, okay. its pretty short.
right now there are only two OSD hosts, and a single mon. which is running on one of the OSDs.
no gateways or anything yet.
# Please do not change this file directly since it is managed by Ansible and wil
l be overwritten
[global]
cluster network = <IP_ADDRESS>/0
fsid = ###########-0495-4b30-a6ec-126a77bb2d30
mon host = [v2:x.x.x.x:3300,v1:x.x.x.x:6789]
mon initial members = HOSTNAME
osd pool default crush rule = -1
public network = <IP_ADDRESS>/0

if you're interested, ceph -s says:

$ sudo ceph -s
[sudo] password for xxxxxx:
  cluster:
    id:     xxxxx-0495-4b30-a6ec-126a77bb2d30
    health: HEALTH_WARN
            Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded, 256 pgs undersized

  services:
    mon: 1 daemons, quorum HOSTNAME (age 15h)
    mgr: HOSTNAME(active, since 15h)
    osd: 13 osds: 13 up (since 15h), 13 in (since 15h)

  data:
    pools:   1 pools, 256 pgs
    objects: 1 objects, 19 B
    usage:   345 GiB used, 24 TiB / 24 TiB avail
    pgs:     2/4 objects degraded (50.000%)
             255 active+undersized
             1   active+undersized+degraded


Crashes when opeing advancement screen

Issue Description:
Game crashes when opening advancement screen either by pressing "L" or pausing and clicking "Advancements".
What happens:
Game freezes, goes to loading screen saying "Saving world", and crashes to launcher
What is expected to happen:
Advancement screen opens with PaginatedAdvancements.
Steps to reproduce:

Open MultiMC and create an instance with Fabric installed
Add Fabric API, Cloth Config, ModMenu, & PaginatedAdvancements into the "Loader mods" folder
Launch the instance
Open an existing world or create a new world
Once loaded, press "L" (or your advancements keybind) or access the pause menu and click "Advancements"
Watch as the game crashes
...

Affected Versions:

PaginatedAdvancements: 1.1.0-1.19
Minecraft: 1.19
MultiMC 5: 0.6.15-3247
Fabric Loader: 0.14.8
Fabric API: 0.27.0+1.19
Cloth Config: 7.0.73
ModMenu: 4.0.4

Most recent log file where the issue was present:
Crash Report

fixed


Added parsing of time intervals

The new function search_dates_interval returns a list of tuples with the substring representing the date or time interval and a dictionary with the parsed date, the beginning and end date and an is_range boolean indicating if it is a time interval.
Examples:

search_dates_interval('The first artificial Earth satellite was launched on 4 October 1957.')
[('on 4 October 1957',
{'date_obj': datetime.datetime(1957, 10, 4, 0, 0),
'date_begin': None,
'date_end': None,
'is_range': False})]

search_dates_interval('January.')
[('January 2009',
{'date_obj': datetime.datetime(2009, 1, 30, 0, 0),
'date_begin': datetime.datetime(2009, 1, 1, 0, 0),
'date_end': datetime.datetime(2009, 1, 31, 0, 0),
'is_range': True})]

search_dates_interval('2010')
[('2010',
{'date_obj': datetime.datetime(2010, 1, 30, 0, 0),
'date_begin': datetime.datetime(2010, 1, 1, 0, 0),
'date_end': datetime.datetime(2010, 12, 31, 0, 0),
'is_range': True})]

A parsed date with the period 'week', 'month' or 'year' is considered a time interval.
In the case of relative dates, if it is a future date then date_begin is the current date and date_end is the parsed date. Inversely for past dates, date_begin is the parsed date and date_end is the current date.

This is very useful and necessary functionality! What are plans for merging this PR?

This seems related to #262.

Hi, it is great function !
When the function will be available ?
It did not work when I tried
dateparser.search_dates_interval('22 au 24 mars 2019')
AttributeError:` module 'dateparser' has no attribute 'search_dates_interval'

I must say I don’t see the point with these changes. Can’t you obtain all of the new values from the date_obj and period values already?


RFC: support setting run location from CLI and CLI config

As a user, I want to determine against which run location / region my checks are executed when using npx checkly test so I can choose the region that best reflects my user base or performance characteristics.
Proposal

[x] Introduce the --run-location <location> CLI flag. The <location> is the short code e.g. eu-west-1 not the friendly name "Ireland". Adding this flag forces all runs to take place from that location.

[ ] Introduce the runLocation default in the cli section of checkly.config.js so people can determine a default to always use. This setting will be overridden when users also specify the flag, e.g. the flag takes precedence.

We currently have --location and --private-location flags for checkly test. Having separate flags is useful for the implementation since the backend needs to distinguish between public and private locations.
For checkly.config.js, I propose that we accept a runLocation or runPrivateLocation field. If both are set, we could either give preference to one field or throw an error. I think that throwing an error works better.


Creating external tables attempts to put all external tables in dbo schema

Issue Type: Bug
When creating external tables on a BDC, all the external tables are created in the DBO schema, even if the tables are in a different schema on the source system. This is very problematic when there are two tables with the same name, in different schemas.  ADS just fails to create the external table and doesn't give any information as to why.
To repro, create a new schema on your source system called test1.  Create the table dbo.account and test1.account.
Create external tables using the GUI for both these tables.
Azure Data Studio version: azuredatastudio 1.14.1 (f9b968c1ae514a0d1210788629e1c69125857279, 2019-12-24T02:42:26.303Z)
OS version: Windows_NT x64 10.0.17134

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-8650U CPU @ 1.90GHz (8 x 2112)

GPU Status
2d_canvas: enabledflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmetal: disabled_offmultiple_raster_threads: enabled_onoop_rasterization: disabled_offprotected_video_decode: enabledrasterization: enabledskia_renderer: disabled_offsurface_control: disabled_offsurface_synchronization: enabled_onvideo_decode: enabledviz_display_compositor: enabled_onviz_hit_test_surface_layer: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
undefined

Memory (System)
15.93GB (1.91GB free)

Process Argv

Screen Reader
no

VM
0%

Extensions (13)

Extension
Author (truncated)
Version

admin-pack
Mic
0.0.2

admin-tool-ext-win
Mic
0.0.2

agent
Mic
0.45.0

dacpac
Mic
1.1.0

datavirtualization
Mic
1.2.0

import
Mic
0.12.0

managed-instance-dashboard
Mic
0.3.9

powershell
ms-
2019.12.0

profiler
Mic
0.11.0

server-report
Mic
0.2.1

whoisactive
Mic
0.1.3

azdata-sanddance
msr
1.3.9

plan-explorer
Sen
0.9.6

@mrdenny You're able to modify the schema during table creation by changing the value in the input box for the destination table

It looks like it currently isn't populating the schema with the source schema which would probably improve this experience but I wanted to make sure first that you were at least able to modify the schema without issue.

You can, but this is done table by table. For this example I a couple hundred tables across three schemas, and having them all in dbo by default didn’t work.
Thank You,
Denny Cherry
Owner & Principal Consultant
Denny Cherry & Associates Consulting, an Inc. 5000 company
denny<EMAIL_ADDRESS>(o) +1<PHONE_NUMBER>tel:3236861478 | (d) +1<PHONE_NUMBER>tel:2139733669
Online Calendar Bookingshttps://calendly.com/mrdenny
[cid:image001.png@01D601E8.F8FE1590]http://www.dcac.co/
<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>From: Charles Gagnon<EMAIL_ADDRESS>Sent: Tuesday, March 24, 2020 1:31 PM
To: microsoft/azuredatastudio<EMAIL_ADDRESS>Cc: Denny Cherry<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [microsoft/azuredatastudio] Creating external tables attempts to put all external tables in dbo schema (#8997)
@mrdennyhttps://github.com/mrdenny You're able to modify the schema during table creation by changing the value in the input box for the destination table
[image]https://user-images.githubusercontent.com/28519865/77473963-867baa80-6dd3-11ea-8545-53eda255bdcf.png
It looks like it currently isn't populating the schema with the source schema which would probably improve this experience but I wanted to make sure first that you were at least able to modify the schema without issue.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/azuredatastudio/issues/8997#issuecomment-603488695, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEZIJAX6KTJILKUDWUKVTATRJEKANANCNFSM4KN6AKRA.

Yeah - that's a good point. I'll try to take a look at this while I'm doing the other work to at least fix it to default to the source schema if that schema exists in the destination DB. There's a lot more we could do here but that should hopefully be an easy fix in the short term.

That would be a good solution. Or even just create the schema if it doesn’t exist.
Thank You,
Denny Cherry
Owner & Principal Consultant
Denny Cherry & Associates Consulting, an Inc. 5000 company
denny<EMAIL_ADDRESS>(o) +1<PHONE_NUMBER>tel:3236861478 | (d) +1<PHONE_NUMBER>tel:2139733669
Online Calendar Bookingshttps://calendly.com/mrdenny
[cid:image001.png@01D601F0.D84DBB40]http://www.dcac.co/
<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>From: Charles Gagnon<EMAIL_ADDRESS>Sent: Tuesday, March 24, 2020 3:27 PM
To: microsoft/azuredatastudio<EMAIL_ADDRESS>Cc: Denny Cherry<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [microsoft/azuredatastudio] Creating external tables attempts to put all external tables in dbo schema (#8997)
Yeah - that's a good point. I'll try to take a look at this while I'm doing the other work to at least fix it to default to the source schema if that schema exists in the destination DB. There's a lot more we could do here but that should hopefully be an easy fix in the short term.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/azuredatastudio/issues/8997#issuecomment-603537235, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEZIJARHRFHYWH24XVVKTW3RJEXUDANCNFSM4KN6AKRA.

Just merged in a fix so that it'll default to the source schema if that schema exists in the destination DB. I'll close this now then - there's extra enhancements that could be done to make this more fully featured (such as creating schemas) but that's currently not work we have planned to take on.

That'll work. People can create the schema in advance and that's a reasable thing to ask people.
Thank You,
Denny Cherry
Owner & Principal Consultant
Denny Cherry & Associates Consulting
<EMAIL_ADDRESS>| +1<PHONE_NUMBER>

From: Charles Gagnon<EMAIL_ADDRESS>Sent: Thursday, April 2, 2020 5:15:56 PM
To: microsoft/azuredatastudio<EMAIL_ADDRESS>Cc: Denny Cherry<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [microsoft/azuredatastudio] Creating external tables attempts to put all external tables in dbo schema (#8997)
Just merged in a fix so that it'll default to the source schema if that schema exists in the destination DB. I'll close this now then - there's extra enhancements that could be done to make this more fully featured (such as creating schemas) but that's currently not work we have planned to take on.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/azuredatastudio/issues/8997#issuecomment-608160508, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEZIJAV74DROJOXLVM4E4KDRKUTDZANCNFSM4KN6AKRA.


Plugin is not working on latest iOS platform

Great plugin. Thank you very much.
This plugin is working perfectly in all Android devices (as much as I have checked on), but same is not true for iPhone device.
Expected Behaviour

Disabled/blurred screenshots in Android/iOS

Actual Behaviour

Able to take screenshots on iPhone (iOS 11.1.2 and iOS 11.2.2) {  }

Reproduce Scenario (including but not limited to)
Steps to Reproduce

Any way of taking screenshots.

Platform and Version (eg. Android 5.0 or iOS 9.2.1)

iOS 11.1.2 and iOS 11.2.2

What device vendor (e.g. Samsung, HTC, Sony...)

Apple

Cordova CLI version and cordova platform version
cordova --version  :- 8.0.0
cordova platform version ios :- ~4.5.4 (also checked on 4.4.0)

Plugin version
cordova plugin version :- 0.3.1

List of other plugins which are included in my project -
cordova-plugin-app-launcher 0.4.0 "Launcher"
cordova-plugin-appavailability 0.4.2 "AppAvailability"
cordova-plugin-console 1.1.0 "Console"
cordova-plugin-device 2.0.1 "Device"
cordova-plugin-iroot 0.4.0 "iRoot"
cordova-plugin-privacyscreen 0.3.1 "PrivacyScreenPlugin"
cordova-plugin-splashscreen 5.0.1 "Splashscreen"
cordova-plugin-statusbar 2.4.1 "StatusBar"
cordova-plugin-whitelist 1.3.3 "Whitelist"
ionic-plugin-keyboard 2.2.1 "Keyboard"

Sample Code that illustrates the problem

I am uing this plugin in Ionic project.
Follow 5 min official guide to start new app.
Add this plugin to project using this plugin's guide
Add iOS platform to project using - ionic cordova platform add ios
Build iOS project files for Xcode - ionic cordova build ios
Now using Xcode, you can emulate app in iOS emulator.

Please let me know if I could be of any assistant.

I don't believe this has ever worked in such manner on iOS, which doesn't make it a real issue as this is a plugin which main point is it "secures your app from displaying a screenshot in task switchers under Android and iOS".
Ability to block screenshots on Android is an extra feature, not the main focus of this plugin.

i confirm the plugin is not working on iOS

@keinajar I must have misunderstood this plugin's tagline. I guess I got a thick skull :smile:


iOS feature request: Option to move Mark all as read on right side

As a right hand dominant user I would like an option to put Mark all as read on the right side of the screen.

Pity.
As i already wrote on Slack, it can be very unusual to have the “Mark as read”-button on the left site and it can be very unhandy when you have a large display.
I guess this feature request isn't on of these "too many options". It's a very usefull request.
Especially there RSS clients out their with such an option.

Please conside it again.


feat: add recursive inserstion sort

Description of Change

Checklist

[x] Added description of change
[x] Added file name matches File name guidelines
[x] Added tests and example, test must pass
[x] Added documentation so that the program is self-explanatory and educational - Doxygen guidelines
[x] Relevant documentation/comments is changed or added
[x] PR title follows semantic commit guidelines
[x] Search previous suggestions before making a new one, as yours may be a duplicate.
[x] I acknowledge that all my contributions will be made under the project's license.

Notes:

Hey we are close to approving this. Question is this for hacktoberfest?

Hey we are close to approving this. Question is this for hacktoberfest?
Yes


Windows 8 Issue ! Menu (Window -> Bring All to Front) and (About Rocket.chat)

I have a Javascript Error whene send menu to action.
On.Click Menu
{
Window -> Bring All to Front and
Rocket.Chat -> About Rocket.chat)
}

I removed all menus throwing errors on windows and linux for now.

duplicated of #9


CTE with no database qualifier in select statement causes dbeaver persist to drop procedure

Description
DESCRIPTION
When editing a procedure in the properties/source window then clicking Save --> Persist, dbeaver will throw an error "No database selected".  The user then needs to exit by clicking OK.  The procedure tab is then closed by clicking x and the user must answer NO to "Do you want to persist these changes in the database".  Following this, refreshing the tree view shows that the procedure has been completely dropped from the database.
This appears to happen under the following circumstances

a default database is not selected for the database connection
when a CTE is present in the procedure and no database qualifier is used when specifying the table in the from clause.

EG - ERROR OCCURS.
CREATE DEFINER=root@localhost PROCEDURE testdb.test(in test1 int)
BEGIN
with cte_test as (
select x from t1						-- this causes the issue where missing db qualifier.
)
select x
;
END
EG - NO ERROR
CREATE DEFINER=root@localhost PROCEDURE testdb.test(in test1 int)
BEGIN
with cte_test as (
select x from testdb.t1		-- this is ok
)
select x
;
END
EG - NO ERROR
CREATE DEFINER=root@localhost PROCEDURE testdb.test(in test1 int)
BEGIN
with cte_test as (
select x 		-- this is ok
)
select x
;
END
This is the full error.
SQL Error [1046] [3D000]: (conn=12) No database selected
(conn=12) No database selected
(conn=12) No database selected
Note that this procedure can be created by executing an sql create statement in the SQL editor with no issues.
DBeaver Version
Community Edition Version <IP_ADDRESS>307231901
Operating System
Windows 10 Home 22H2 19045.3208
Database and driver

Database name and version:  MariaDB 11.0.2-MariaDB
org.mariadb.jdbc.Driver RELEASE[3.0.7]  (default driver downloaded by dbeaver)

Steps to reproduce

Connect to database and and ensure no default database is selected.
Open SQL editor.
Execute the following create statement to create the procedure

CREATE PROCEDURE test (in test1 int)
BEGIN
with cte_test as (
select x from t1	-- this causes the issue where missing db qualifier.
)
select x
;
END

Refresh tree view and expand the database and procedures folder
Double click test procedure that has just been created and select "source" in the main window
Make any adjustment to the procedure (add a space or delete/replace a character
Click Save.  (Another editor window will pop up with the DDL to be executed.
Click Persist (An error window will pop up with error "(conn=xx) No database selected"
Click OK
Attemt to close the procedure viewer by clicking X on tab at the top of the screen
A new window will pop up titled "Persist object changes".  Click NO (clicking yes will repeat the process)
The procedure tab will close.
Refresh the tree view - it can be observed that the procedure has been dropped.

dbeaver-debug.log
Copy.log
Additional context
No response

Thanks for your bug report!


I need to get the documentID populated in a "docId" variable in my struct

I have a struct that looks like the code below.
I've also written a generic class, and a function "loadItems()" to read items from firestore (See code below)
When the snapshotdata is decoded to the type that T represents, the documentID isn't mapped to any of the fields in the struct.
I've search around a fair bit and can't find any solution that works for me since I'm using generics i can just assign it in the loop where i decode the data.
struct CartItem: Codable & Equatable {

    enum CodingKeys: String, CodingKey {

        case userId = "userId"
        case docId = "docId"
        case productName = "productName"
        case quantity = "quantity"
        case imageName = "imageName"
        case name = "name"
        case email = "email"
        case measure = "measure"
        case phone = "phone"
        case description = "description"
        case address = "address"
        case price = "price"
    }

    let userId: String?
    let docId: String?
    let productName: String?
    let quantity: String?
    let description: String?
    let imageName: String?
    let name: String?
    let email: String?
    let price: String?
    let measure: String?
    let phone: String?
    let address: [String: String]?
}

func loadItems(completion: @escaping ([T])-> Void) -> [T] {
        handle = Auth.auth().addStateDidChangeListener { (auth, user) in
            if ((user) != nil) {
                self.ref = self.db.collection(self.collectionName).whereField("userId", isEqualTo: user!.uid)
                self.ref?.getDocuments(completion: { (querySnapshot, err) in
                    if let err = err {
                        print("Error getting documents: \(err.localizedDescription)")
                            }
                    else {
                        if let snapshotDocs = querySnapshot?.documents {
                            for doc in snapshotDocs {
                                var data = try! FirestoreDecoder().decode(T.self, from: doc.data())
                                self.items.append(data)
                            }
                            completion(self.items)
                        }
                    }
                })
            }
            else {

                print("Not Logged In")
                self.items = []
            }
        }
        return items
    }

Did you solve this?

I did. But with more of a work around than fixing the actual Issue.


KAFKA-16861: Don't convert to group to classic if the size is larger than group max size.

Fix the bug where the group downgrade to a classic one when a member leaves, even though the consumer group size is still larger than classicGroupMaxSize.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

I noticed that we don't have IT for downgrading to classic group. Maybe we can add IT in this PR?

Sounds good, I will write an integration test for downgrading to classic group

@dongnuo123 is working in adding integration tests for all this work stream. We should wait.
@chia7712 We do already have unit tests but we missed one for this particular case.

@dongnuo123 Could you please review this PR?

@frankvicky Out of curiosity, how did you find the bug? Regarding the integration tests, if you want to help, we can sync with @dongnuo123.

Out of curiosity, how did you find the bug?

@dajac the ticket is created by me (see https://issues.apache.org/jira/browse/KAFKA-16861), and I noticed that issue when reading the new coordinator.

if you want to help, we can sync with @dongnuo123.

@dongnuo123 Please feel free to make this fix be a part of your PR if you are adding integration tests for all this work stream.

@chia7712 We can merge this one with the unit test. That’s fine. I just wanted to ensure that we don’t do duplicate work on the integration tests part of it.

Hi @dajac,
As @chia7712 mentioned, I am cooperating with @chia7712 on this issue. It seems that @dongnuo123 is working on the integration test for this. If that is the case, please feel free to incorporate this fix into your PR.
Thank you! 😺

@frankvicky Thanks for this! As I said, I am fine with merging the fix. We should definitely keep it. I just wanted to signal that there is an ongoing effort from @dongnuo123 to add integration and system tests for the upgrade/downgrade paths.

@frankvicky @dajac thanks for all your responses. I will take a look at this PR later. @dajac it would be great if this PR can have reviews from you :)

Sure. I can review it tomorrow.

@chia7712 Do you want to review it too?

Do you want to review it too?

I will take a look later!

Merged to trunk and to 3.8.


⚠ Bofrost.fr has degraded performance

In f4bc48d, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 961 ms

Resolved: Bofrost.fr performance has improved in 1bfa77a after 6 minutes.


Dlib installation time error   it says      running setup.py install for dlib did not run successfully.

  ISSUES ASKING QUESTIONS ABOUT WHY SOMETHING DOESN'T WORK THAT FAIL TO FILL OUT THE ENTIRE TEMPLATE WILL BE CLOSED.
It is OK to suggest interesting improvements to dlib, even if you are not volunteering to implement them.  However, the issue tracker is not a code writing service, do not ask for someone to write code for you.  E.g. Do not ask for feature improvements to the example programs. If there is some feature improvement you want in an example program then it's up to you to write it.
Before you ask a question, check Google for a solution, the dlib FAQ, or consult the dlib documentation.  Every single function in dlib is documented in detail.  If you obviously haven't read the documentation your issue will be closed.
If you aren't reporting a bug or problem with dlib then delete this template and write whatever you want here.

Expected Behavior

Current Behavior

Steps to Reproduce

Version:
Where did you get dlib:
Platform:
Compiler:

I have one doubt dlib module not install
It says
running setup.py install for dlib did not run successfully.


Add Japan Open Chain Testnet

Network information

Name: Japan Open Chain Testnet
ChainId: 10081
RPC http/s address: https://rpc-1.testnet.japanopenchain.org:8545/
Link to https://chainlist.org/: https://chainlist.org/chain/10081
Blockexplorer: https://explorer.testnet.japanopenchain.org/

When we provide a PR please deploy the singleton and if possible post an answer on this issue with the links to the blockexplorer addresses.

Did you deploy the contract?

[x] I have run RPC='http://my-rpc-address' yarn estimate

$ ts-node scripts/estimate.ts
{ chainId: 81 }
{ estimate: '68131' }
{ gasPriceGwei: '100.0', gasPrice: '100000000000' }
{ requiredFunds: '0.0068131' }
✨  Done in 4.96s.

[x] I have sent requiredFunds to 0xE1CB04A0fA36DdD16a06ea828007E35e1a3cBC37
https://mainnet.japanopenchain.org/tx/0x9b1a0e5b5e9a56cabdd520e791b7467dfe9d7d7d04979fe1346f5d05e02458fbv

Hi @Uxio0, Thank you for your support:

[x] I have run RPC='http://my-rpc-address' yarn estimate

$ ts-node scripts/estimate.ts
{ chainId: 10081 }
{ estimate: '68131' }
{ gasPriceGwei: '100.0', gasPrice: '100000000000' }
{ requiredFunds: '0.0068131' }
✨  Done in 5.75s.

[x] I have sent requiredFunds to 0xE1CB04A0fA36DdD16a06ea828007E35e1a3cBC37
https://explorer.testnet.japanopenchain.org/tx/0x753288ccf45ed9949c12766a0604376a9543c33824df2a9669950b7309811b1b

It has been deployed it at https://explorer.testnet.japanopenchain.org/tx/0x63c83947288413003555b6ca97d60021f3ac802440487a7e7f3212bbdc3a4f84. Could you close this?


refactor: remove default and require imports cu-amupbe

Please provide enough information so that others can review your pull request:
Motivation
Explain the motivation for making this change. What existing problem does the pull request solve?

Task linked: DEV-51 Code refactoring


Remove all TODOs in the PWA

Description

We probably shouldn't leave TODOs in the project since the projects are not upgradable once they are generated.
Types of Changes

[ ] Bug fix (non-breaking change that fixes an issue)
[ ] New feature (non-breaking change that adds functionality)
[ ] Documentation update
[ ] Breaking change (could cause existing functionality to not work as expected)

Breaking changes include:

Removing a public function or component or prop
Adding a required argument to a function
Changing the data type of a function parameter or return value
Adding a new peer dependency to package.json

Changes

remove all todo comments, no code change

How to Test-Drive This PR

(step1)

Checklists

General

[ ] Changes are covered by test cases
[ ] CHANGELOG.md updated with a short description of changes (not required for documentation updates)

Accessibility Compliance
You must check off all items in one of the follow two lists:

[ ] There are no changes to UI

or...

[ ] Changes were tested with a Screen Reader (iOS VoiceOver or Android Talkback) and had no issues
[ ] Changes comply with WCAG 2.0 guidelines levels A and AA
[ ] Changes to common UI patterns and interactions comply with WAI-ARIA best practices

Localization

[ ] Changes include a UI text update in the Retail React App (which requires translation)

I'm on the fence about this ticket now. Obviously we don't want to have TODO statements in our generated code as it's not upgradable, and it probably doesn't look good overall. But I still believe TODO's provide valuable information for developers to help track deficiencies. An alternative solution would be to strip out TODO statements from the code during the create-app build step. What are your thoughts @kevinxh ?

created a ticket to address this problem: https://gus.lightning.force.com/lightning/r/ADM_Work__c/a07EE00000CQwXrYAL/view.
Closed.


Index of joint-space inertia matrix (JSIM)

Hi,
I'm building a controller to control a UR5 robot to manipulate a rope object (96 linked object). When I use the mj_fullM function to convert data.qM to the dense format, I found it's dimension is 196 x 196. To control the UR5, I only need the JSIM of the 6 joints of UR5. My question is, how can I index the 196 x 196 JSIM to get the JSIM of UR5? I attached my zipped MJCF file below. Thanks.
ur5_rope_c.zip

Are you using Python or C? The answer is different depending on how you are accessing MuJoCo.

Hi @yuvaltassa, I'm using Python.

Firstly, the order of joints is the same as in the XML. So maybe you just know the indices by virtue of where the robot is defined. If you're not sure you can do
joint_indices = [model.joint(i).id for i in range(model.njnt) if `UR5` in model.joint(i).name]

Or whatever substring will identify your robot joints. You can also give all your robot joints some user value
<joint ... user="1"/>

and do
joint_indices = [model.joint(i).id for i in range(model.njnt) if model.joint(i).user[0] == 1]

Or similar.
Thenm after calling mj_fullM you just slice:
M[joint_indices, joint_indices]


Add GitHub Actions support

Add workflow to run pmd and checkstyle on every push and pull request. The official GitHub Actions documentation is the best place to start from.

Done


materializecss added

In the header,php

Materialize.css stylesheet added
Nav bar added
li updated

Can you please share the screenshot for the changed items ?

Okay sure. But the problems is my web browser is not rendering .php files. So I have to change it .htm, work on it and then change it back to .php.

 There you go.
I am facing problem as my browser is unable to render the .php files. So I have to convert them to .htm and work on it and then change it back. I am unable to run the project properly on my local machine.

For running the php code, you need Apache Server, you can know more about on how to install here http://php.net/manual/en/book.apache.php

I have xampp already installed and also Apache comes by default on Ubuntu but still my browser is not able to render. I will try to fix it again.
Anyway is that what you wanted ? Does my PR fulfill your requirements ?

Yes, please attach the screenshot of the complete home page after running.
May be you haven't created the database with the mentioned tables in the README file. For easiness for all, you can create a database and also add its link in README file.
Refer new issue of that: https://github.com/NJACKWinterOfCode/E-voting-portal/issues/5

@bksahu  You might have Apache server preinstalled but the php won't be rendered unless you point the browser to the localhost server directory.
From the secreenshot, I see you are viewing the page from 'file://xyz' which is pointing to the server, you need to point to the server for it to render.

git clone the repository inside your server root(/var/www/html by default or look up in your apache config)
point the browser to localhost/{name of subfolder where you cloned this in the server root directory}

@tameeshB Already done. There was some problems with Apache and I fixed it. Now my browser renders php properly.


Implicit do-block in functions

(def print-and-return (fn (y) (println y) y))

This currently returns nil but should return y
Perhaps with the structure for this, the ugly wrapping of files could also be done in a nicer way: https://github.com/alcesleo/lasp/blob/84a7f436f7860a0f7ab28d540ee7a9a788e6041b/lib/lasp.rb#L10

The defn macro adds a do block, this is definitely good enough.
https://github.com/alcesleo/lasp/commit/1602db8d6921482839bdf3c2e8d2dd73b6bd2dec


override template !!

hello please how can override store template??
thanks!!!

You can use the StoreOverrideBundle if you want to define an entire new template or StoreFallbackBundle if you want to use the default one and overwrite some parts of it.
What does it mean? Well, use app/Resources/StoreOverrideBundle/views/ for your new template or app/Resources/StoreFallbackBundle/views/ for overwritting the default one :)


Adding the NorNE dataset for Norwegian POS and NER

NorNE is a manually annotated corpus of named entities which extends the annotation of the existing Norwegian Dependency Treebank. Comprising both of the official standards of written Norwegian (Bokmål and Nynorsk), the corpus contains around 600,000 tokens and annotates a rich set of entity types including persons, organizations, locations, geo-political entities, products, and events, in addition to a class corresponding to nominals derived from names.
See #1720.

Awesome!


renames element fi to delv tech

Codecov Report
Patch and project coverage have no change.

Comparison is base (0d5ece2) 77.93% compared to head (d1e104b) 77.93%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #366   +/-   ##
=======================================
  Coverage   77.93%   77.93%
=======================================
  Files          30       30
  Lines        4087     4087
=======================================
  Hits         3185     3185
  Misses        902      902

Flag
Coverage Δ

unittests
77.93% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

elfpy/markets/hyperdrive/hyperdrive_market.py
74.80% <ø> (ø)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Version 4.3.0

Handle Task Queues
Some updates to PMD, Highlighting in docs

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@95cf1e0). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #44   +/-   ##
=======================================
  Coverage        ?   93.66%
=======================================
  Files           ?       20
  Lines           ?     3015
  Branches        ?        0
=======================================
  Hits            ?     2824
  Misses          ?      191
  Partials        ?        0

Flag
Coverage Δ

Apex
93.66% <0.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 95cf1e0...bb8fa6e. Read the comment docs.


Do not suggest Golden Dracula theme extension for Go projects with .golden files

VSCode Version:
OS Version:

Steps to Reproduce:

Open any Go project which has .golden files in its testdata/ directories
VS Code suggest that there are extensions to help with .golden files, suggests installing the Golden Dracula theme extension (ext:golden)
That extension does not help with Go golden files

Possible ways to improve this:

If the .golden file is in a directory named testdata/ then do not suggest the extension.
If there is a go.mod file in the parent directories, then do not suggest the extension.

.golden files are pretty common in the Go community: they are used by the Go authors for testing the standard library, the gofmt tool, etc. and are a common pattern in the Go community for snapshot testing outside the official Go project.

Does this issue occur when all extensions are disabled?: Yes

It is unfortunate that golden theme has a tag name golden and hence this is being shown. Not sure if there is anything we can do here 😞

It is unfortunate that golden theme has a tag name golden and hence this is being shown. Not sure if there is anything we can do here 😞


Draw text cursor in InputLayout.paint, not Tab.render

This PR makes cursor drawing the InputLayout's responsibility. The downside of this approach is that it requires each node to know whether or not it is focused, but it turns out we need that later anyway, and the new approach avoids some graphics glitches when an <input> element is transformed. In total I think it also makes the text a bit simpler.

I will note that I tested this (hence the random bugfixes)

Kind of a funny story about lab15.py but ultimately you are right, it is better to update it.


FLINK-28359 Test case to replicate TO_TIMESTAMP bug

Added test cases to show that TO_TIMESTAMP does not preserve precision
Hi, I open this PR to show there might be a bug, this is not intended to be merged

Please don't open pull request for things you don't want to merge, just provide your code in the Jira ticket in such a case.


Implement And Test Post Withdraw Hooks

Extracts common withdrawal functionality into shared internal methods
Defines an interface for Umbra post withdraw hooks
Implements withdraw methods that call this hook after the token withdrawal completes
Adds tests exercising post withdraw hook usage

TODO:

[x] Fix umbra-js signature methods (and others?)

closes #37

Also, I haven't thought about this much yet, but worth discussing is how this approach compares to just adding target, and data input parameters and having Umbra.sol do the call directly

I think the primary reason to use a pre-defined interface, instead of just arbitrary target + call data, is that without the interface, you can't develop a receiving contract that can act trustlessly on the withdrawal parameters it receives. For example, the receiving contract wouldn't know which token or what amount of it had been withdrawn.

Also, this is similar enough to the above ERCs that, if we stick with this approach, there may already be a similar, non-token specific ERC we should use instead of basically writing our own. Or we could even just exactly follow the conventions of one of those above ERCs where it makes sense to, for method names, etc.

Well, given that we have different/additional parameters to consider, I think it has to be different from other standards, which have their own values to forward. Agree with looking at those standards and following similar conventions where possible! I actually based the implementation off of ERC777 but will give them all another look over.

After running yarn at the root, then cd contracts and yarn test, my tests fail pretty quickly:

Is it possible you have another local network running somewhere? I think that might be the issue, but not sure.

Is it possible you have another local network running somewhere? I think that might be the issue, but not sure.

You were right, I did, though that didn't resolve the issue unfortunately. If I run yarn hardhat node and yarn hardhat test --network localhost in two different terminal windows, everything works fine and tests pass, but now if I run yarn test I get the below error. @wildmolasses Are you able reproduce this / have any ideas?
yarn run v1.22.10
$ concurrently --success first --kill-others "hardhat node &>/dev/null" "hardhat test --network localhost"
[1] Creating Typechain artifacts in directory typechain for target ethers-v5
[1] Successfully generated Typechain artifacts!
[1] web3-shh package will be deprecated in version 1.3.5 and will no longer be supported.
[1] web3-bzz package will be deprecated in version 1.3.5 and will no longer be supported.
[1] Error HH108: Cannot connect to the network localhost.
[1] Please make sure your node is running, and check your internet connection and networks config
[1] For more info go to https://hardhat.org/HH108 or run Hardhat with --show-stack-traces
[1]
[1] hardhat test --network localhost exited with code 1
--> Sending SIGTERM to other processes..
[0] hardhat node &>/dev/null exited with code SIGTERM
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.


{Monitor} fix live test

Description

Against the latest live test report https://clitestresultstac.blob.core.windows.net/20201211-043721-979918/monitor.report.parallel.html

test test_metric_alert_for_rg_and_sub is untouched, just pass after rerun. No idea why live test failed.
test test_monitor_clone_vm_metric_alerts_scenario is untouched, just pass after rerun. No idea why live test failed.
test test_monitor_log_analytics_workspace_data_export is untouched, just pass after rerun. No idea why live test failed.
test test_monitor_log_analytics_workspace_data_export failed because service introduce a breaking change without notifying us and it's awarded by the user #15742. @kairu-ms will take care of it.
test test_monitor_private_link_scope_scenario is buggy due to service problem who complaining that can't find a just-created resource, so record_only it.

Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change.
[Component Name 2] az command b: Add some customer-facing feature.

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

[ ] I adhere to the Error Handling Guidelines.

Monitor

/azp run


Pause overlay Info

When you pause a video you see some information about your torrent regarding download/upload speed, filename how much has been downloaded etc.
This information is very helpful sometimes but I would like to see it without the need to press the pause.
Is this possible to add keymap or a way to show this information without needing to press the pause?

Kodi is handling all key presses and assigning actions to run for each key.
I don't see any way to bind a keymap into Kodi.

It is possible to show this information, for example, when you call the "Player process info", or "Video information"? that way its not needed to bind a keymap.

I don't know of such options in Kodi.
Any help is welcome.

when playing a video and press "I" this "windows" appears.
https://imgur.com/Bk6X6v4


Add category to commands shown in palette and scope them to appropriate contexts

Adds "GitHub Pull Requests" category to all contributed commands that appear in the command palette. Limits the command palette contributions to

"GitHub Pull Requests: Refresh"

when the user isn't in PR Mode, and

"GitHub Pull Requests: Close Pull Request"
"GitHub Pull Requests: Open Pull Request in GitHub"
"GitHub Pull Requests: View Pull Request Description"
"GitHub Pull Requests: Refresh"

when in PR Mode that act on the currently checked out PR.

I'm not sure if we should add a "Checkout Pull Request" command that's always available in the command palette or not... dealing with pagination is a bit strange within the quick pick. For a "Load more" button, it would be possible to display another quick pick with a longer list of options. But if all the PRs aren't shown by default, trying to search will only search whatever page is being shown. I tried implementing getting all PRs and displaying them in the quick pick, but there's a pretty noticeable delay between choosing the command and the quick pick showing up with the options (for the VSCode repo with our many PRs). Maybe this is fine though as most repositories will probably have fewer PRs. @rebornix thoughts?

Here's what it looks like trying to fetch all PRs in VSCode:

Maybe another option to the IPullRequestsPagingOptions to control page size would help

Or possibly

Ok, that sounds reasonable. I'll add that separately and check in what I have now, which removes the "Checkout Pull Request" command from the palette.


typo: incorrect middleware method references

This PR contains a:

[ ] bugfix
[ ] new feature
[ ] code refactor
[ ] test update
[x] typo fix
[ ] metadata update

Motivation / Use-Case
Incorrect reference to middleware object methods
Breaking Changes
none
Additional Info
none

Thanks for the PR :beer:
Please note that this section will change in v2.0.0 and your changes might not be the same after that branch is merged.


Working with CartoDB

Is is possible to create data layer from cartodb?

Please refer to Getting Help section in the README (or #469).


⚠ Bofrost.at has degraded performance

In f6b8d4b, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 2398 ms

Resolved: Bofrost.at performance has improved in 0f7383b.


the shortucu keys of the local application cannot be used

I would like to ask why the shortcut keys of the local application cannot be used when the remote application is in full screen after I open the remote application using rail.

Sorry, wjat do you mean?

When I remotely open a chrome, use the F11 key to enter full-screen mode, and the shortcut keys for software installed on the local computer will no longer work in this remote chrome window

When I have A local application where "ctrl + A" is the screenshot shortcut, I can't use "ctrl + A" to take a screenshot in the focus window when calling in full screen mode

@tao363 well, only system shortcuts work.
each rails window is like a virtualbox/vmware/kvm viewer window capturing all keyboard input and redirect it to the server.
since there is no proper way to know which keyboard combinations to escape everything is redirected . the only exception being the window manager (or compositor in case of XWayland) combinations which are not received by the window in the first place.

Can I modify it to restrict certain fixed combination shortcuts from being redirected? such as restrict the redirection of "ctrl + alt + A"

Yes, but that currently requires a recompile

How should I modify it? Are there any corresponding documents or documents that can be read?

How should I modify it? Are there any corresponding documents or documents that can be read?

no.
check where the keyboard events are handled (xf_event.c) and add new combinations.


Newest windows 11 update from 26.09.2023 needs support, kernel version 10.0.22621.2361

After installing the latest windows 11 update which enable some 23H2 functions (not insider or preview) the SI driver says it needs an update.
reported kernel version: 10.0.22621.2361
PS: on some of my machines this happens on its own on others the enablement update kb5027397 causes it, seams the Rollout is done in stages.

Support was added already here: https://github.com/winsiderss/systeminformer/commit/d1a6baf440e357f1c1806554ad97df4a5972c3de
It's on the train for the next build 👍


DeepAR Model export RuntimeError: Please first call block.hybridize() when trained with hybridize=True

Description
I'm trying to log a trained DeepAR predictor to a MLFlow experiment and I get an error saying that I should hybridize the model when I trained it with the hybridize=True parameter set.
To Reproduce
estimator = DeepAREstimator(
    trainer=Trainer(
        hybridize=True
    )
)

predictor = estimator.train(train)

mlflow.gluon.log_model(predictor.prediction_net, "model")

Error message or code output
RuntimeError: Please first call block.hybridize() and then run forward with this block at least once before calling export.

Environment

Python version: 3.7
GluonTS version:0.10.5
MXNet version:1.9.1

@lostella thanks for your reply
When I pass the train dataset to as_symbol_block_predictor  I get this error :
ValueError: all the input array dimensions for the concatenation axis must match exactly, but along dimension 1, the array at index 0 has size 53 and the array at index 2 has size 41

My train dataset is built like this:
train = PandasDataset.from_long_dataframe(
    train_df.set_index(TIME_COL),
    target=TARGET,
    item_id=GROUP_COL,
    freq=FREQ,
    feat_static_cat=STATIC_COLS,
    feat_dynamic_real=['eoh_store_scale', 'eoh_dc_scale', 'eoh_total_scale']
)

With the target and the individual feat_dynamic_real arrays each of lentgh 41 (ts_length - horizon)
I don't know what could be the size 53 array that fails to be concatenated since I don't pass one during training
Do you have an idea of what that could be ?

@Vzlentin sorry for the late reply. It’s hard to say, but it’s a shape issue. Could you come up with a minimal example reproducing the issue? With fake data it’s fine (random, or all ones). Then we can discuss on that

@lostella there you go:
`
import pandas as pd
import numpy as np
from gluonts.dataset.pandas import PandasDataset
from gluonts.model.deepar import DeepAREstimator
from gluonts.mx import Trainer
df = pd.read_csv("test")
df["date"] = pd.to_datetime(df["date"]).dt.tz_localize(None)
split_date = df[df["sls_unt_scale"].isna()]["date"].min()
train_df = df[df["date"] < split_date]
train_ds = PandasDataset.from_long_dataframe(
train_df.set_index("date"),
target="sls_unt_scale",
item_id="line",
freq="M",
feat_static_cat=['product subclass', 'global plan l1','global plan l4', 'global plan brand', 'global plan l2', 'logo', 'merch fabrication', 'global plan l3', 'product class', 'neckline'],
feat_dynamic_real=['eoh_store_scale', 'eoh_dc_scale', 'eoh_total_scale']
)
ds = PandasDataset.from_long_dataframe(
df.set_index("date"),
target="sls_unt_scale",
item_id="line",
freq="M",
feat_static_cat=['product subclass', 'global plan l1','global plan l4', 'global plan brand', 'global plan l2', 'logo', 'merch fabrication', 'global plan l3', 'product class', 'neckline'],
feat_dynamic_real=['eoh_store_scale', 'eoh_dc_scale', 'eoh_total_scale']
)
estimator = DeepAREstimator(
prediction_length=12,
context_length=24,
freq="M",
use_feat_static_cat=True,
use_feat_dynamic_real=True,
cardinality=[1, 1, 1, 1, 1, 1, 1, 1, 1, 1],
scaling=False,
cell_type="lstm",
dropoutcell_type="VariationalDropoutCell",
num_layers=4,
num_cells=40,
dropout_rate=0.4,
alpha=0.05,
beta=0.05,
trainer=Trainer(
epochs=55,
learning_rate=0.009
)
)
predictor = estimator.train(train_ds)
predictions = list(predictor.predict(ds, num_eval_samples=100))
`
The above example works fine if I set use_feat_dynamic_real=False
test.csv
I have attached fake data with the same shape than what I'm trying to use
Many thanks!

I am facing the same problem, any updates on this issue ?


githubPages option does not generate .nojekyll file

Search terms
--githubPages, .nojekyll
Expected Behavior
Expecting a .nojekyll file in the destination output folder.
The documentation states:

--githubPages                                Generate a .nojekyll file to prevent 404 errors in GitHub Pages. Defaults to true

Actual Behavior
There is no .nojekyll file generated, and if there is a .nojekyll file it is deleted.
Steps to reproduce the bug
touch docs/.nojekyll
typedoc --plugin typedoc-plugin-markdown

The .nojekyll file will be deleted.

Environment

Typedoc version: 0.26.3
TypeScript version: 5.5.3
Node.js version: 20.9.0
OS: macOS Sonoma 14.5 M2

typedoc-plugin-markdown

This plugin completely overwrites TypeDoc's renderer, so anything which uses renderer events, like this option, is disabled by it.

Resolved.