Migrate Search Detector tasks to SDK using SDKRestClient

Is your feature request related to a problem?
Part of https://github.com/opensearch-project/OpenSearch/issues/5224
What solution would you like?
Migrate the Search Detector tasks Rest API to Extensions SDK using SDKRestClient.
Use the implementation of #353 as a reference.  Add new issues for any steps you skip.
Implement the following API endpoints:

[ ] GET _plugins/_anomaly_detection/detectors/tasks/_search

The migration work is done in the attached PR.
Wasn't able to test the workflow as the API fails with
 "error": "Request failed with exception: [[.opendistro-anomaly-detection-state] OpenSearchStatusException[OpenSearch exception [type=index_not_found_exception, reason=no such index [.opendistro-anomaly-detection-state]]]]"

.opendistro-anomaly-detection-state index will be created as the part of https://github.com/opensearch-project/opensearch-sdk-java/issues/383

API: <IP_ADDRESS>:9200/_extensions/_ad-extension/detectors/tasks/_search with GET and POST
Query:
{
  "query": {
    "bool": {
      "filter": [
        {
          "term": {
            "detector_id": "-TZfXYcBZWahDDF-C6Mh"
          }
        },
        {
          "term": {
            "task_type": "REALTIME_SINGLE_ENTITY"
          }
        },
        {
          "term": {
            "is_latest": "true"
          }
        }
      ]
    }
  }
}

Response:
{
    "took": 15,
    "timed_out": false,
    "_shards": {
        "total": 1,
        "successful": 1,
        "skipped": 0,
        "failed": 0
    },
    "hits": {
        "total": {
            "value": 1,
            "relation": "eq"
        },
        "max_score": 0.0,
        "hits": [
            {
                "_index": ".opendistro-anomaly-detection-state",
                "_id": "-zZfXYcBZWahDDF-a6MO",
                "_version": 1,
                "_seq_no": 105,
                "_primary_term": 29,
                "_score": 0.0,
                "_source": {
                    "detector_id": "-TZfXYcBZWahDDF-C6Mh",
                    "task_progress": 0.0,
                    "last_update_time":<PHONE_NUMBER>146,
                    "execution_start_time":<PHONE_NUMBER>146,
                    "state": "CREATED",
                    "task_type": "REALTIME_SINGLE_ENTITY",
                    "init_progress": 0.0,
                    "is_latest": true,
                    "detector": {
                        "description": "Test detector",
                        "feature_attributes": [
                            {
                                "feature_id": "n4JeXYcBnxLZhpku4uYI",
                                "feature_enabled": true,
                                "feature_name": "test",
                                "aggregation_query": {
                                    "test": {
                                        "sum": {
                                            "field": "value"
                                        }
                                    }
                                }
                            }
                        ],
                        "schema_version": 0,
                        "time_field": "timestamp",
                        "last_update_time":<PHONE_NUMBER>589,
                        "indices": [
                            "server_log*"
                        ],
                        "window_delay": {
                            "period": {
                                "unit": "Minutes",
                                "interval": 1
                            }
                        },
                        "result_index": "opensearch-ad-plugin-result-test1",
                        "detection_interval": {
                            "period": {
                                "unit": "Minutes",
                                "interval": 1
                            }
                        },
                        "name": "test-detector13",
                        "filter_query": {
                            "bool": {
                                "filter": [
                                    {
                                        "range": {
                                            "value": {
                                                "include_lower": false,
                                                "include_upper": true,
                                                "from": 1,
                                                "boost": 1.0,
                                                "to": null
                                            }
                                        }
                                    }
                                ],
                                "adjust_pure_negative": true,
                                "boost": 1.0
                            }
                        },
                        "shingle_size": 8,
                        "detector_type": "SINGLE_ENTITY"
                    }
                }
            }
        ]
    }
}


Error: AttributeError: type object 'Retry' has no attribute 'DEFAULT_METHOD_WHITELIST'

We have following task which is failing with below error:
Tasks:
#===== Configure Databricks CLI =====
- task: configuredatabricks@0
displayName: Configure Databricks CLI
inputs:
url: $(databricks_url)
token: $(sm-dbw-access-token)
#===== Deploy Notebooks to Workspace =====
- task: deploynotebooks@0
displayName: Deploy Notebooks to Workspace
inputs:
notebooksFolderPath: $(Pipeline.Workspace)/drop/notebook
workspaceFolder: /NOTEBOOKS/etl1
error:
Starting: Deploy Notebooks to Workspace
Task         : Deploy Databricks Notebooks
Description  : Recursively deploys Notebooks from given folder to a Databricks Workspace
Version      : 0.5.6
Author       : Microsoft DevLabs
Help         :
/opt/hostedtoolcache/Python/3.10.6/x64/bin/python -V
Python 3.10.6
Version: 3.10.6
Python3 selected. Running...
/opt/hostedtoolcache/Python/3.10.6/x64/bin/databricks workspace import_dir -o --profile AZDO /home/vsts/work/1/drop/notebook /NOTEBOOKS/etl1
Error: AttributeError: type object 'Retry' has no attribute 'DEFAULT_METHOD_WHITELIST'
##[error]The Notebooks import process failed.
Finishing: Deploy Notebooks to Workspace
We used following workaround to mitigate issue.
https://github.com/databricks/databricks-cli/issues/634
We also think issue could also be caused by
https://github.com/urllib3/urllib3/pull/2086/commits/ba593472e6b7230038f73560dde5321e72471246
Can you please confirm if this is causing error and provide us solution to avoid that workaround. So we can have permanent fix for the issue.

I have the exact same issue.
I cross checked a current build with one from March.
The build that failed last night showed this:
...
Collecting requests>=2.17.3 (from databricks-cli)
Downloading requests-2.30.0-py3-none-any.whl (62 kB)
...
Collecting urllib3<3,>=1.21.1 (from requests>=2.17.3->databricks-cli)
Downloading urllib3-2.0.2-py3-none-any.whl (123 kB)
...
Where as the one from March showed
...
Collecting requests>=2.17.3
Downloading requests-2.28.2-py3-none-any.whl
...
Collecting urllib3<1.27,>=1.21.1
Downloading urllib3-1.26.15-py2.py3-none-any.whl
I believe we want this combination, which is what my original environment.yml states and is referenced in the links below
pip install requests==2.25.1 urllib3==1.26.5
Additional links:
https://stackoverflow.com/questions/76183443/azure-devops-release-pipeline-attributeerror-type-object-retry-has-no-attribu
https://github.com/marcospereirampj/python-keycloak/issues/196


some questions about model

hi, thank you for your great work, I have some questions:

As you mentioned in the paper: adding the attention module before the ConvNext module appears to be the optimal solution.，but I found that in decoder/models.py, the AttnBlock is contained in pos_net which is after convnext. They seem to be in the opposite order as in the paper.
I want to do streaming inference with wavtokenizer, I have replaced all the convolution layers in SEANetEncoder, SEANetDecoder, ConvNeXtBlock and pos_net(ResnetBlock+AttnBlock) with causal convolution layers(class SConv1d with causal=T). Unfortunately, the genetrator loss keeps increasing(see in the pic). Is there any wrong in the modified model?

thank you for your reply!

hi, thank you for your great work, I have some questions:

As you mentioned in the paper: adding the attention module before the ConvNext module appears to be the optimal solution.，but I found that in decoder/models.py, the AttnBlock is contained in pos_net which is after convnext. They seem to be in the opposite order as in the paper.
I want to do streaming inference with wavtokenizer, I have replaced all the convolution layers in SEANetEncoder, SEANetDecoder, ConvNeXtBlock and pos_net(ResnetBlock+AttnBlock) with causal convolution layers(class SConv1d with causal=T). Unfortunately, the genetrator loss keeps increasing(see in the pic). Is there any wrong in the modified model?

thank you for your reply!

The code is consistent with the paper, with the attention module placed before the ConvNeXt blocks. https://github.com/jishengpeng/WavTokenizer/blob/02c66cbb4b05b3ee225419f00f3914eb1854b7d5/decoder/models.py#L225
We have also experimented with WavTokenizer-Streaming and found the performance to be satisfactory. The issue you are encountering appears to be a bug or some other underlying cause. During modification, only the parameters of the encoder need to be adjusted, while for the decoder, detailed changes to the attention and convolution modules are required.

The code is consistent with the paper, with the attention module placed before the ConvNeXt blocks. Link
We have also experimented with WavTokenizer-Streaming and found the performance to be satisfactory. The issue you are encountering appears to be a bug or some other underlying cause. During modification, only the parameters of the encoder need to be adjusted, while for the decoder, detailed changes to the attention and convolution modules are required.

thank you for your reply. I will try it. BTW, should I add mask in AttnBlock?

The code is consistent with the paper, with the attention module placed before the ConvNeXt blocks. Link
We have also experimented with WavTokenizer-Streaming and found the performance to be satisfactory. The issue you are encountering appears to be a bug or some other underlying cause. During modification, only the parameters of the encoder need to be adjusted, while for the decoder, detailed changes to the attention and convolution modules are required.

In fact, the loss curve was the same when I didn't change the code (on both libritts and ljspeech), and I didn't understand why this was the case, I just changed the following configuration:
data:
  class_path: decoder.dataset.VocosDataModule
  init_args:
    train_params:
      filelist_path:./data/LJSPEECH/train.txt
      sampling_rate: 24000
      num_samples: 24000
      batch_size: 16  # 20
      num_workers: 8

    val_params:
      filelist_path: ./data/LJSPEECH/val.txt
      sampling_rate: 24000
      num_samples: 24000
      batch_size: 5   # 10
      num_workers: 8


⚠ Bofrost.at has degraded performance

In faec353, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 2051 ms

Resolved: Bofrost.at performance has improved in 8feefd0 after 13 minutes.


Third person controller added

Opening as a draft as the camera is not yet ready.
Let me know what you think of the implementation and also the way the player "rotates".
There are two ways we can go about it:

It moves forward and pressing left or right makes it rotate around its Y axis, thus, changing directions
Pressing left makes it move to the left, up and left goes diagonally, etc.. This is how it's currently.

Tomorrow I should commit the camera if there are not many changes required.
ps: PRing here as we don't have any godot projects in the other repository.

We should create a new repository for this, it's going to be a standalone controller. I'll create a repo and ping you again so you can push your PR there.

Let me know what you think of the implementation and also the way the player "rotates".

The code and the character's feel are off. You shouldn't convert vectors to strings and compare them to apply hard-coded rotations. The movement code shouldn't be absolute: it should be relative to the camera. But at least you can't code a character controller separately from its camera. I would personally have started with the base camera rig.
You should use vector calculations as much as possible, especially when setting the character's angle. Never use lerp to calculate motion.
For the movement, we should use root motion. I'll have to check if the root motion is in the exported character though.
There's quite a bit to review and change. I'll create a new repository and write down more precise requirements because it's not starting well.

Could you please PR to this repo? I'll do the detailed review there: https://github.com/GDquest/godot-3d-mannequin

Sure, no worries, though, the repository is empty - I'm not able to PR.

I just added a readme, should be okay now


UI Browser and the see word show word definitions with syntax words expanded

For example, the below definition graft* for browser-gadget shows on the UI browser and in the listener result of M\ browser-gadget graft* see as:
M: browser-gadget graft*
    [ add-definition-observer ]
    [ M\ browser-gadget graft* (call-next-method) ] bi ;

It shows in the source code of ui.tools.browser vocab as:
M: browser-gadget graft*
    [ add-definition-observer ] [ call-next-method ] bi ;

That's because a deficiency in the parser which throws away the literal definition of words. I think @erg is working on a new parser too. See #758.


Add Profile : @tusharmishra069

A pull request should be created from this issue if not kindly ping @dinxsh ⚠

.take

@tusharmishra069 the contributor app is not working, thats why profile is not adding you can refer this issue: #660


browse main page returns no results

Steps to reproduce
open browse, nothing
Expected behavior
able to see just added, new, trending, what ever else all the categories are
Actual behavior
a blank page with an error, it will still let me search, but the page is blank
Crash logs
No response
Neko version
2.16.3
Android version
android 13
Device
galaxy tab s7+
Other details
It has been like this for a while, but after the new update didn't fix it, I decided to report.
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open issue.
[X] I have written a short but informative title.
[X] I have updated the app to the newest version Latest.
[X] I have filled out all of the requested information in this form.

Is this still an issue?

yep

Can you dump an error log.

Can you dump an error log

neko_crash_logs (9).txt

Nothing there, you are gonna have enable debug logs in advanced settings, force close app.  emulate issue. then send that log.  (Don't forget to disable the debug logs after)

I assume what you wanted was verbose logging on,
neko_crash_logs (10).txt
if not, I am not seeing a better option

Interesting there is no error..  On the next release let me know if the error message changes

will do

updated, still nothing.

Did the error message change though

sorry bout the delay, turned verbose logging on, restarted app, went to the page, and dumped log
neko_crash_logs (11).txt


add testsite data

Thank you for submitting your data!
Please ensure this checklist is complete before creating the pull request.

[ ] My branch name is the same as my Site_ID
[ ] All of my data files are named <site_ID>_data*.csv
[ ] All columns are present in my data file(s)
[ ] All columns are named properly
[ ] Data are coded according to the data dictionary
[ ] All measures are within the appropriate scales and distribution

To check boxes, change - [ ] to - [x]
Once you create the pull request, we will automatically check your data files.
If the test fails, you can see the output:

Click Details next to the failed job
Click Run script to view the output of the QC checks

++ 1 data files found
++ ---------
++ Checking data file: ./data/testsite/testsite_data1.csv
++ 7 ERRORS FOUND:
    Column names do not match data dictionary
    age range is suspect, age(s) outside of 60 - 264 months found
    brain_behavior_measurement_date minus dob should equal age, found entries where this is not true
    iq range is suspect, entries should be between the broad range of 0 and 200
    gm_volume entries must all be greater than 0 and less than 1,000,000
    wm_volume entries must all be greater than 0 and less than 1,000,000
    icv entries must all be greater than 0 and less than 5,000,000
++ Missing columns:
    amygdala_volume
    autism_diagnosis
    cbcl_attentionproblem_raw_score
    cbcl_externalizing_raw_score
    cbcl_internalizing_raw_score
    parental_education
++ Extra columns found:
    education
    scrn_asd
    simulatedDataBeh_long$cbcl_attentionproblem_raw_score * rnorm(numberOfRows,
    simulatedDataExt_long$cbcl_externalizing_raw_score * rnorm(numberOfRows,
    simulatedDataInt_long$cbcl_internalizing_raw_score * rnorm(numberOfRows,
    simulatedDataVolAmg_long$amygdala_volume * rnorm(numberOfRows,
++ ----------
++ Finished with errors.

++ 1 data files found
++ ---------
++ Checking data file: ./data/testsite/testsite_data1.csv
++ 12 ERRORS FOUND:
    age range is suspect, age(s) outside of 60 - 264 months found
    brain_behavior_measurement_date minus dob should equal age, found entries where this is not true
    parental_education entries need to be one of the following: 1, 2, 3, 777
    cbcl_externalizing_raw_score range is suspect, entries should be between 0 and 70
    cbcl_internalizing_raw_score range is suspect, entries should be between 0 and 64
    cbcl_attentionproblem_raw_score range is suspect, entries should be between 0 and [20]
    iq range is suspect, entries should be between the broad range of 0 and 200
    gm_volume entries must all be greater than 0 and less than 1,000,000
    wm_volume entries must all be greater than 0 and less than 1,000,000
    amygdala_volume entries must all be greater than 0 and less than 10,000
    frontal_lobe_gm_thickness entries must all be greater than 0 and less than 5
    icv entries must all be greater than 0 and less than 5,000,000
++ ----------
++ Finished with errors.

++ 1 data files found
++ ---------
++ Checking data file: ./data/testsite/testsite_data2.csv
++ 2 ERRORS FOUND:
    Column names do not match data dictionary
    parental_education entries need to be one of the following: 1, 2, 3, 777
++ Missing columns:
    subject_id
++ Extra columns found:
    subject_id
++ ----------
++ Finished with errors.

re: subject_id weird. I have a meeting in 5 mins but I can look into this after

This helps, there is a bug to where the script will say ERROR: There was a problem reading data file: {file} if one of the dates are in the wrong format

++ 1 data files found
++ ---------
++ Checking data file: ./data/testsite/testsite_data2.csv
++ 1 ERRORS FOUND:
    parental_education entries are not close to correct proportions
++ ----------
++ Finished with errors.

I think that's the best you can do with only 3 rows!

@nedasadeghi FYI the parental education proportion check is:
  # get proportions for 0, 1, 2, 3 (after rmoving 777)
  test = 1
  educ = educ[educ != 777]
  # 0 entries
  educ0 = (sum([i==0 for i in educ])/len(educ))*100
  if educ0 < 0.5 or educ0 > 10:
      test = 0
  # 1 entries
  educ1 = (sum([i==1 for i in educ])/len(educ))*100
  if educ1 < 30 or educ1 > 40:
      test = 0
  # 2 entries
  educ2 = (sum([i==2 for i in educ])/len(educ))*100
  if educ2 < 20 or educ2 > 30:
      test = 0
  # 3 entries
  educ3 = (sum([i==3 for i in educ])/len(educ))*100
  if educ2 < 30 or educ2 > 40:
      test = 0
  # check test
  if test==0:
      errors.append('parental_education entries are not close to correct proportions')

Let me know if you want something different

@dmoracze I am thinking maybe it's better if we remove the parental education constrain. Also, can you please add a check for the number of rows.

@nedasadeghi will do! I had it on my to do list for today but meetings ended up filling the day. It'll be the first thing I do tomorrow. I'll let you know when it's done.

@nedasadeghi @ivdvelpen
I have made some changes to the check data script:

removed the parental_education proportion check
fixed a bug with date format checking
added a summary report

For this pull request, the script output now looks like:
++ 1 data files found
++ ---------
++ Checking data file: ./data/testsite/testsite_data2.csv
++ Date File Summary:
    Number of rows: 3
    Number of columns: 19
    Number of correctly names columns: 19
    Number of unique subjects: 2
    Age column: mean=102.0, min=84, max=114
    Number of males: 1
    Number of females: 1

++ No errors found!
++ ----------
++ Finished without errors!

Unfortunately for you to have this new script run on either of your open pull requests, you'll need to delete your fork and start again, because your fork has the old version of check_data.py
Please let me know if you would like me to add more to the summary report


Fix required vs optional argument denotation

Fixes #388.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

good catch! I'll get this merged once the build completes.


V8 WishList: Support $filter=geo.distance(a, b) le distance

Support distance between two points.
Given a DTO that includes a Microsoft.Spatial.GeographyPoint named "Location", support the following filter:
$filter=geo.distance(location, geo.point(10, 20)) le 1000.00

The geo.distance should return a double in kilometers.  Support both 2 and 3 argument forms of geo.point and all the evaluations (eq, ne, le, lt, ge, gt).

Predecessor: #852

Fixed in 9b7cd30.  However, this highlighted a client side evaluation bug that needed addressing.  this is now fixed as well.


[WIP] Adds metaphysics static data fetcher

Adds a basic, hackey metaphysics call as per https://github.com/artsy/prediction/issues/119 Next steps will be to set up static data from the response, then make the existing sale state fetching code collate its results into something the UI can consume.
Note: this PR is against socket-events because I wanted some changes from that branch, but I wanted to keep this work separate. Feedback on this welcome here, or wherever.

3 Warnings

:warning:
PR is classed as Work in Progress

:warning:
Needs testing on a Phone if change is non-trivial

:warning:
Found unstubbbed networking requests

ARFairFavoritesNetworkModelSpec in test_ignores_artworks_without_a_partner
ARFairFavoritesNetworkModelSpec in test_ignores_artworks_without_a_partner
ARFairFavoritesNetworkModelSpec in test_ignores_artworks_without_a_partner

  Generated by :no_entry_sign: danger

Closing to open against master.


How does the sensor need to be implemented?

I need to use the sensor in the process, how should I set up the rigid body to achieve this?
Sent from PPHub

A sensor should be implemented using a Trigger collider in ReactPhysics3D. You can find more information in the documentation here.
Note: Next time, can you please ask your question in the Discussions section instead of opening a new issue because this is not an issue? Thanks

I am closing this issue. Feel free to create a new discussion instead if this is still not clear.


Max String Size Extended / Reusing Existing Tablespaces with data

Hi,
Nice work on the docker image thanks.
Would be good if you can manage to have the image already with 'max string size' in extended mode instead of 'standard' (or an easy way to do it.
At the moment I have it on a startup script and always needs couple of shutdowns and startups with and without upgrade option. Which does take a while to do. Then I will try attaching exiting volumes (tablespaces). Ideally be in a position where I left off last time I used it.
In essence, what everyone wants from all this.  But trying to do all this, is very hard. (btw i am running docker on windows).
So ideally, first setup a DB with extended max string size and tablespaces:
-> with windows mapping directories for the dbs path, startup script.
o set max string size extended
https://smarttechways.com/2022/02/11/ora-43929-collation-cannot-be-specified-if-parameter-max_string_sizestandard/
o create tablespaces
o create users
o create tables etc...
o populate the tables
o export the tablespaces (as I guess this is the only way to use again)
o bash logon to export the associate dump file
Then further restarts can be:
-> with windows mapping directories for the dbs path, startup script.
o set max string size extended
o load tablespaces
o create users
For me, having as much of this as part of the image or easily to do it would make the image useful. Trying to load up a chunks of data every time just takes to long to make it useful.
I hope I am doing it all the right way.
Please let me know.
Thanks in advance,
Den

Hi @dolphin54,
Thanks a lot for using these images!
I am hesitant to deviate too much from the standard Oracle XE setup as I want to ensure that people get the same "look and feel" that they would get from any other Oracle XE installation.
Deviating from it may make people and their software rely on certain functionality that they then will not have somewhere else, causing more pain further down the road.
When you attach an existing volume with tablespaces, could you not just attach a database with max_string_size already configured altogether?
The image is smart enough to detect an already existing database and will just start it up.
So as long as you save the entire oradata folder which includes the database and config files, you should just get back to where you left off right there.
An alternative approach could be to extend the image, where the max_string_size configuration is performed once and a new image then generated.


[dns-sd] Expose operational node TXT entries

Problem
Currently, the resolver interface for operational node discovery only returns IP address and port, and TXT entries
are ignored.
Change overview
Extend the interface to expose values published via TXT entries such as CRI, CRA and T.
Print those values in chip-tool and "dns resolve" shell command output.
Testing

Unit tests for TXT entry parsing and populating ResolveNodeData structure added.
Also, tested manually using chip-tool built with both minimal mDNS and Avahi implementations, and using nRF Connect Lock example build with west build -b nrf52840dk_nrf52840 -- -DCONFIG_CHIP_LIB_SHELL=y which enables "matter dns resolve" shell command.

Also note the MRP/TCP bits are not just in operational entries now after https://github.com/CHIP-Specifications/connectedhomeip-spec/pull/3647


Mysql testResource instead of devservices

fixes https://github.com/apache/camel-quarkus/issues/6657
The FIPS testing is much more easier if simple test container is used.

I  switched to draft as a different approach should be used.

The behavior had to be changed, it is not possible to disable devservice from the TestResource. I kept the FIPS profile, which stops dev service. TestResource starts the container only in case of stopped devservice


G1 fibers not working

Xinxin came in because we were getting an error that the ITItime parameter was incorrect for G1, which was keeping it from starting. He said that the code had been changed. He was able to change the code back to get G1 to work, but he told us that Kenta and Xinxin need to go in and create a new code of the fibers in order to get the G1 fibers to work.

I guess this is about old configuration where behavior and FP were in separate workflows, and a completely different issue from what we are experiencing thesedays. Close?

This is long ago and has been resolved. Thanks.


View Finals Location

User Story:
As a student, I want to be able to view where my finals are being held so that I know where to go to attend them.

Scenario:
Given the user is logged in
And the user is a student
And the user is currently enrolled in classes
When the Finals Schedule Card appears
Then ensure the Finals Schedule Card displays the locations of Finals

Issue is complete as the Finals Card displays locations for finals.


ARC-1231 Preemptive rate limit

What's in this PR?
Preemptively delay backfill messages if the backfill meets a given threshold, currently sources from a number flag on Launch darkly.
Why
We need the backfill to settle down sometimes so webhooks don't get skipped while the backfill is chugging along
Added feature flags
https://app.launchdarkly.com/github-for-jira/development/features/preemptive-rate-limit-threshold/targeting
Affected issues
ARC-1231
How has this been tested?
Unit tests have been added for exceeding the threshold and within.
PR IN DRAFT WHILE STAGE TEST PENDING
Whats Next?
Play with feature flag values to find the sweet spot

Looks good to me :)

So from the doc here: https://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-visibility-timeout.html
I think we are good right now, just need to keep it in mind though. Should be fine.
For most standard queues (depending on queue traffic and message backlog), there can be a maximum of approximately 120,000 in flight messages


helper.env_file removes hash (#) at the end of an environment variable value in task definition

Hi there. First of all, thanks for this awesome gem.
One of my environment variables looks like this:  SOME_KEY=WYNL3g!EvjSLG&W#
The helper method will always remove the trailing #, so in the resulting task definition file, the variable always looks like this:
{
  "name": "SOME_KEY",
  "value": "WYNL3g!EvjSLG&W"
 }

Adding double or single quotes around the value doesn't help. Any suggestions?

@cekediz Thanks for pointing out the edge case bug. Issue is that ufo parses the .env files and strips out trailing comments. So you can add comments to the if you'd like.
Fixed in https://github.com/tongueroo/ufo/commit/6340e79103e386db9370f2822a5782728bc0a8fd
Released in version 4.1.4 https://github.com/tongueroo/ufo/blob/master/CHANGELOG.md


Losing random packets RCE_GENERIC_FORMAT

Hello,
I have been trying for some time to transmit H264 packets via uvgRTP. I don't need RTP_FORMAT_H264 because NVENC gives me the packets with all the necessary information, that's why I use the Generic interface. I have problems with packet loss even if the size offered by uvgRTP corresponds to that of the sender. But when I save the same scene in a file, for example, the final sizes of the two files differ, which makes me think that there is a limitation that I don't understand yet. I also set a longer length of the UDP buffer, but without success.

RTP not RCE

Hello.
What do you mean by packet loss in this case?
You should use RTP_FORMAT_H264, since that determines the packetization format inside uvgRTP. If NVENC outputs packets without start codes (based on other issues I've read, it probably does), you should add RTP_NO_H26X_SCL flag to push_frame flags.
Does this help?
BR, Joni

Ok, if NVENC puts the start codes (001 o r 0001) in front of the NAL units, then the flag should not be used as the default configuration looks for start codes and removes them. At the receiving end, uvgRTP adds the start codes back in and if this is undesirable for some reason, this functionality can be disabled with RCE_NO_H26X_PREPEND_SC flag at the receiving end.
RTP_FORMAT_H264 flag also includes fragmentation, which is needed for most transmission over the internet (a similar functionality is achieved by RCE_FRAGMENT_GENERIC, but RTP_FORMAT_H264 is the correct solution from specification perspective).
Currently, transmitting data over a VPN requires lowering the MTU size, because the default is too large. Does calling sender->configure_ctx(RCC_MTU_SIZE, 1400); fix the packet loss?
BR,
Joni Räsänen

Changing MTU_SIZE to a lower value (1350 - 1400) brought significant improvements, the artifacts not being as aggressive, for that a big thank you.
Compare with Parsec, uvgRTP is an aproppiate solution for Remote Desktop.

Instead, according to the rules, I used RTP_FORMAT_H264, but at 40 - 50 frames uvgRTP displays a warning ([uvgRTP][WARNING][::garbage_collect_lost_frames] Found an old frame that has not been completed. Ts: 687483914, Seq: 53151 < -> 53158, received/expected: 7/8), which leads me to think of a possible mistake in my implementation.
Sender side:

uvgrtp::context ctx;
uvgrtp::session* sess = ctx.create_session("<IP_ADDRESS>");
uvgrtp::media_stream* stream = sess->create_stream(8081, RTP_FORMAT_H264, RCE_SEND_ONLY);
stream->configure_ctx(RCC_FPS_NUMERATOR, 60);
stream->configure_ctx(RCC_UDP_SND_BUF_SIZE, 40 * 1024 * 1024)
stream->configure_ctx(RCC_MTU_SIZE, 1400);
//stream->configure_ctx(RCC_PKT_MAX_DELAY, 16);
//stream->configure_ctx(RCE_PACE_FRAGMENT_SENDING, 60);
//stream->configure_ctx(RCC_SESSION_BANDWIDTH, 40000);

stream->push_frame((uint8_t*)pck_desc.data, pck_desc.size, RTP_NO_H26X_SCL);
Where pck_desc is a structure where I got the packets once every 16 ms. I suspect that this is the problem, maybe the packets cannot be sent in a time less than or equal to 16 ms, probably in the next cycle I overwrite pck_desc.data over something that is already being processed. In the reception part, as in the example, I use a hook. The question is, there any method in which I can be notified back if the frame was sent successfully?

With respects,
Gheorghita Robert

I'm glad to hear it helped.
That warning is an indication that a packet was lost somewhere. This can be due to the network losing it, but it can also be something that can be improved with some changes to uvgRTP usage. The sending side is very straightforward and is unlikely to be the cause of frame loss, but the receiving side is not and can sometimes lose packets in high performance situations.

You can try to add RCE_PACE_FRAGMENT_SENDING to sending side RCE flags with | (not configure_ctx), which may improve the receiver performance
I recommend not setting RCC_UDP_SND_BUF_SIZE unless everything else has been tried, since it is only needed in extreme cases (if at all).
You can try increasing the RCC_RING_BUFFER_SIZE at receiver (default is 4 MB, set as number of bytes, try 40 MB)
You can also try without RCC_FPS_NUMERATOR (and RCE_PACE_FRAGMENT_SENDING), since in its current state it may not always be reliable and cause problems
You can also try setting the MTU size slightly higher, as this will improve the performance of receiver (fewer packets)

In my own tests, a packet is lost occasionally, but nothing close to every 50 frames.
The push_frame does not utilize threads, so it has sent everything by the time the function returns.
BR,
Joni Räsänen

The changes above brought a small improvement, however the major problem was with Wireguard, because when it received larger buffers (P-frames) it ignored them and the artifacts comes from here. The best solution would be for 2 remote computers to connect to each other directly without VPN, probably through a STUN server. For those who want to use uvgRTP via VPN, change the MTU to a lower value solves many of the problems. Thanks again for the advice.
With respects,
Gheorghita Robert

The VPN situation is documented in docs folder readme.
STUN server is used to figure out your address translation in NAT (for example, google offers free servers for this). You can also try to guess your outer address/port if you know your routers address, because usually the router keeps the port the same if possible.
In other words, you should be able to stream video directly even from behind a NAT if you just use your router address in the sending end as destination and send data in the other direction as well from the receiver. For sending dummy data in the other direction, uvgRTP has a keep-alive flag (use the API which has both send and receive addresses).
BR, Joni

@RobertWn16 Just out of curiosity, what is the encoding/decoding latency that you get for a 4K video with NVENC?

@wowaser
In RTX 3060 scenario:

7-8 ms encoding 8 bit-depth, 10-12 ms encoding 10 bit-depth(HDR10).
3-4 ms decoding 8 bit-depth, 11-13 ms decoding 10 bit-depth including PQ transfer function which increase the delay with 5-6 ms.

In Qudaro P620 scenario:

encoding latency is high(around 20 - 25 ms).
7-8 ms decoding 8 bit-depth, 15-19 ms decoding 10 bit-depth(HDR10).

I've tested with Desktop Duplication API , 3840x2160 at 60 fps. I dont know what will happens for 120 Hz, 165Hz etc.


Not working with Ionic

Hi, I'm using Ionic + Angular and the library doesn't work, it show very extrange (see image). I'm trying to use it with reactive forms.
<tagify formControlName="email"></tagify>

newClintForm = new FormGroup({
  identificationType: new FormControl('', Validators.required),
  indentification: new FormControl('', Validators.required),
  name: new FormControl('', Validators.required),
  socialReazon: new FormControl('', Validators.required),
  address: new FormControl('', Validators.required),
  email: new FormControl([], [Validators.email, Validators.required]),
  phone: new FormControl('', Validators.required)
})

The standard validators won't work with this kind of data. Try to remove the validators and look if it then behaves correctly.
You can pass a specific pattern to the tagify settings to validate the input:
const EMAIL_REGEXP =
    /^(?=.{1,254}$)(?=.{1,64}@)[a-zA-Z0-9!#$%&'*+/=?^_`{|}~-]+(?:\.[a-zA-Z0-9!#$%&'*+/=?^_`{|}~-]+)*@[a-zA-Z0-9](?:[a-zA-Z0-9-]{0,61}[a-zA-Z0-9])?(?:\.[a-zA-Z0-9](?:[a-zA-Z0-9-]{0,61}[a-zA-Z0-9])?)*$/;

this.tagifySettings: TagifySettings = {
  pattern: EMAIL_REGEXP
};

<tagify formControlName="email" [settings]="tagifySettings"></tagify>

I tried as you mentioned but didn't work, I removed the validators and I used the settings property, but in this way if I write in the input inmediatly the value is erased.  I tried even using ngModel way but I had the same problem (it shows very strange like the image).
I attach an image of the console with the ngmodel mode.

I found the problem, I forgot include the styles... Now it works perfect.
Sorry and thanks for the help.


python/bandit: Use .bandit configuration file

Bandit automatically uses any .bandit file within the directories on which it is invoked.  Since ALE invokes bandit on -, it does not load a .bandit file automatically.  Add support for automatically finding a .bandit file and passing it to bandit via the --ini option along with a variable to disable this behavior if desired.
Note: This is useful for the skips and tests configuration options, but not exclude which would require invoking bandit using a file name, which may or may not be a good trade-off.
Thanks for considering,
Kevin

Cheers! :beers:

Thanks again @w0rp!  :clinking_glasses:


feature request: add an RSS feed for the blog

Apparently Astro supports this:
https://docs.astro.build/en/guides/rss/

Sure, I'll see what I can do. Posts probably wont be frequent, but I'll get this done before the next one.

Done!
https://blue-build.org/feed.xml
https://blue-build.org/blog/


mvp-cockpit: cannot create new repository

http://<IP_ADDRESS>:7182/ays81/Repos

cannot reproduce


[BugFix] Fix use-after-free in GlobalRuntimeFilter

In some cases, columns will be used after free, this PR fix it.
What type of PR is this:

[ ] BugFix
[ ] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Does this PR entail a change in behavior?

[] Yes, this PR will result in a change in behavior.
[x] No, this PR will not result in a change in behavior.

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[ ] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.2
[x] 3.1
[x] 3.0
[x] 2.5

[FE Incremental Coverage Report]
:heart_eyes: pass : 0 / 0 (0%)

[BE Incremental Coverage Report]
:disappointed: fail : 0 / 2 (00.00%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
src/exprs/runtime_filter_bank.cpp
0
2
00.00%
[472, 477]

@Mergifyio backport branch-3.2

@Mergifyio backport branch-3.1

@Mergifyio backport branch-3.0

@Mergifyio backport branch-2.5


test lunaria

[ ] favorites cache may have error

Jubal gives micahs code about this

from @MicahZoltu Discord message

I got the Lunaria transaction hash error again @jubalm.  It seems related specifically to sending ETH to a contract perhaps.  > In the first case, I sent money to a Gnosis SAFE.  In this case, I sent money to a proxy contract.


Neater output to command line.

I fixed a minor bug when over the character limit. The output command is on a seperate line now, easier to select with triple click in command line. Commenting is mentioned with the 'INIT:' and 'COND:', as it is just a hashtag.

the first commit, I agree. The functionality in the second commit is intended. If we wanted the newline there, we'd have ommitted the func keyword argument as opposed to func=sys.stderr.write

I'll merge this tomorrow when I'm coherent enough to know what I'm doing.
On Sat, Aug 29, 2015 at 1:20 AM coolsa<EMAIL_ADDRESS>wrote:

I fixed a minor bug when over the character limit. The output command is
on a seperate line now, easier to select with triple click in command line.
Commenting is mentioned with the 'INIT:' and 'COND:', as it is just a
hashtag.
You can view, comment on, or merge this pull request online at:
https://github.com/destruc7i0n/OneCommand/pull/5
Commit Summary

Fixed error when command is to long, added note for comments.
Added newline when telling user command in command line.

File Changes

M oneCommand.py
https://github.com/destruc7i0n/OneCommand/pull/5/files#diff-0 (6)

Patch Links:

https://github.com/destruc7i0n/OneCommand/pull/5.patch
https://github.com/destruc7i0n/OneCommand/pull/5.diff

—
Reply to this email directly or view it on GitHub
https://github.com/destruc7i0n/OneCommand/pull/5.


[DX] When Full-stack signals feature flag is not set, it should throw an exception during the startup

Describe the bug
When Full-stack signals feature flag is not set, there is no error in the server-side console/terminal, and a blank page is loaded on the browser. If the user opens the browser's console, there is a clear error about the feature flag missing, and how to set it. However, for Java full-stack developers, it is confusing, and normally, it is not their first choice to open the browser's console as the first step.
Expected-behavior
When the Full-stack signals feature flag is not set, and the full-stack signals are used, it is convenient to prevent the application from getting any further during the startup, with a clear message that indicates what is missing and where it should be set.
Background:
The Spring Beans needed for Full-stack Signals are not created unless the feature flag is set. This is controlled via annotating the beans with @ConditionalOnFeatureFlag("fullstackSignals"). So, in case an exception should be thrown, all browser-callable methods' return types should be scanned to check whether any full-stack signals are being returned without setting the feature flag or not.
Controlling the value of this feature flag during the instantiation of the full-stack signals is not easily possible, as they are not container managed beans.
Reproduction
Without setting the feature-flag for the Full-stack Signals, create a browser-callable service that returns any type of full-stack signals, and run the application.
System Info
Version: Vaadin 24.6 beta1.

Well, the proposed approach of removing @ConditionalOnFeatureFlag("fullstackSignals") doesn't help, since when the application is started, the subscription to the signals will not happen due to the client-side feature flag check throws an Error before any request being sent to the server, so that the SignalHandler get a chance to evaluate the situation and throw a server-side exception.


POST/PATCH validations against openapi.json

Create/update requests are validated against openapi.json schema for parameter format.
It checks only existing properties, unknown properties are checked yet.

[ ] depends on: #36
[x] depends on: https://github.com/ManageIQ/manageiq-api-common/pull/80
Issue: https://github.com/ManageIQ/manageiq-api-common/issues/67

@gtanzillo @abellotti please review

@bdunne please review


Network Analytics Content Validation Issue for github.io website

Section link:

https://azuresdkdocs.blob.core.windows.net/$web/python/azure-mgmt-networkanalytics/1.0.0/index.html#indices-and-tables

Reason:
Format validation issue: Broken Link.
Repro steps:
When you open link1 and click the Module Index of the current page, it cannot display the correct page. The error message is as shown below:

@rohit-ganguly, @lmazuel for notification.

Close this issue as we'll put it into a summarzied one.


Detach Database option does not work

I have not checked previous versions to see if this is a new issue , but <IP_ADDRESS>-unk windows under /Settings/Options/ and the main tab " Detach database at shutdown "
As it says in the hover over what this feature does " Detach block and address databases at shutdown. This means they can be moved to another data directory, but itslows down shutdown. The wallet is always detached "
I normally click that option on my Windows NN helper nodes and recently moved my main wallet to my desk and was looking for a popup/notification option ( next issue post ) and went to click the Detach database at shutdown and noticed the option button stayed grayed out. So I said ok , it's Gridcoin click it and then click OK it will save there must be an error or something passed over. Nope , does not save.. I am not sure as I swear 3.4-.3.5 series had this option working but I could be wrong. I am sorry if this is a known issue and if so please remove this post. I thought the ability to detach is great for those of us whom do backups and regularly copy /Users/Username/AppData/Roaming/Gridcoinresearch/wallet.dat and the client conf or whole directory as I do. This also could/would help if I am not mistaking for making and distribution of snapshots and users could provide their own as we have new seed/ftp sites separate from the download.gridcoin.us site popping up.  Yes it's a safety issue and factor taking just anybodies blk001.blk file along NeuralNetwork etc folders BUT there are also users with multiple nodes whom could help get the network back up when we fork having nodes checked and showing the correct hashes so this could speed up recovery time on forking. If this is just a planned issue can we get the option removed till there? If broken please can we get this fixed and maybe let known this feature is there and that users can help get the Gridcoin network and correct fork of the blockchain back up and running by detaching. Additionally " The wallet is always detached " that does not mean it will not stake and is just a dummy NN client does it? Maybe the explanation of this feature since it does not work will elaborate on that.. Thank you again Rob , ravon , ifoggs , tomasb etc anyone whom works on this..

If it even does anything it is supposed to be one time thing.You check it, it will detach database (?) on shutdown so you can move it. Next time it shuts down normally.


MSID: 96693 Version: 1 DOI: 10.1101/2<IP_ADDRESS>9869

MSID: 96693
Version: 1
Preprint DOI: https://doi.org/10.1101/2<IP_ADDRESS>9869
Step 1. Awaiting reviews
Editorial to post reviews via hypothesis
Useful links:

DocMap: https://data-hub-api.elifesciences.org/enhanced-preprints/docmaps/v2/by-publisher/elife/get-by-manuscript-id?manuscript_id=96693
New model tracking: https://docs.google.com/spreadsheets/d/1_fHaoOy7hjyocptKtVJRijeNpUY4hBS7Ck_aVmx6ZJk/
Reviews on sciety: https://sciety.org/articles/activity/10.1101/2<IP_ADDRESS>9869

For trouble shooting (e.g. no Docmaps available):

DocMap issue addressing: https://miro.com/app/board/uXjVNCwK6EI=/
Explore DataHub DocMaps API: https://lookerstudio.google.com/reporting/4c2f0368-babb-4beb-b5b3-497e7e7b0f08/page/ejphD
Unmatched submissions and preprints: https://lookerstudio.google.com/u/0/reporting/9f86204f-3bf7-477c-9b18-5c5ef141bf69/page/p_gxi57ha93c
Unmatched manuscripts spreadsheet: https://docs.google.com/spreadsheets/d/15QcK8w-ssB7109RQEDtFpJPZ0J5HTGxoHa_2TtpMBbg/edit#gid=1336081641

Step 2. Preview reviewed preprint
Production QC content ahead of publication
Instructions:

QC preview: https://prod--epp.elifesciences.org/previews/96693v1
Update ticket with any problems (add blocked label)
When QC OK, add QC OK label to ticket and add publication date and time to https://docs.google.com/spreadsheets/d/1amAlKvdLcaDp5W8Z8g77NmkwbMF5n_u89ArSqPMO8jg
Move card to next column
(At end of the day post link in #enhanced-preprint and ask for PDF to be generated)

Useful links:

Preprint DOI :  https://doi.org/10.1101/2<IP_ADDRESS>9869
Confirm reviews returned by EPP: https://prod--epp.elifesciences.org/api/reviewed-preprints/96693/v1/reviews
To update the MECA path in the docmap: https://docs.google.com/spreadsheets/d/1mctCQuNFBjSn97Lihy7_vBO6z7-N-oqyLv4clyi6zHg

Step 3: Awaiting search reindex
This step adds the reviewed preprint to the homepage: https://elifesciences.org
The search reindex is triggered once an hour. We need the reviewed preprint to be indexed as the search application serves the journal homepage.
Useful links:

Jenkins pipeline to reindex search can be triggered sooner or monitored here: https://alfred.elifesciences.org/job/process/job/process-reindex-reviewed-preprints/

Step 4: Published! PDF requested
Waiting for PDF to be generated
Useful links:

PDF tracking: https://docs.google.com/spreadsheets/d/106_XeDjmuBae7gexOTNzg60lapeqjl2aRn9DzupGyS8/

Step 5: Introduce PDF to data folder and git repo
Upload PDF to relevent folder in git repo https://github.com/elifesciences/enhanced-preprints-data/
Step 6: Done!

[ ] Kettle is on!

@fred-atherden We seem to have lost the final author; I suspect cludged tagging at bioRxiv because, while the authors indicate two corresponding authors with email addresses in the PDF, there's only one email shared between them online.

Thanks @JGilbert-eLife. Yep a typesetting error - they've captured the rids  the wrong way around according to the relevant notes.
Should update in the next few hours (note I've also moved the figure supplements after their first citation)


Add on_release_outside event in ButtonBehavior, fix #4593

Ohai buddiez, hope you doing goodie ^__^
Everything is in the title and in #4593 .
Thanks in advance!
Have a good one buddiez ^__^

I don't think a new event is required, it's just a issue with the button logic. The fix should be              self._do_release() where self.state = 'normal' currently is.

Totally correct! Please feel free to close/amend my PR, and fix the issue upstream :-)


view notifications with fzf preview

Hello,
fzf is a powerful tool, since it is already included in the project, it could be made even more useful.
Description
This PR aims to allow toggling the preview of an issue/PR with fzf. See GIF below for more clarity.
All styling options are not set in stone, it's just my preference for what looks good. Your repo, your call. Happy to make changes.
I took some inspiration from:

gh-dash
zoxide
random git repos

Explaination for used Arguments

GH_FORCE_TTY=50%

to enable terminal-style output even when the output is redirected.
https://github.com/cli/cli/pull/4146

--ansi --no-multi --reverse --header-first --info=inline

ansi ...
no-multi ...
reverse seems to be more consistent, since any output with the -s flag also sorts them from top to bottom
header-first the header description should be at the top
info=inline the number of results is in the same line as the search

--header

Depending on whether the -o flag is set, the description explains what pressing the Enter key does

--margin 2% --border --color 'border:#778899'

some formatting

--preview-window wrap:hidden:40%:up:border-bottom

wrap makes sure that the lines are not truncated
hidden by default the preview window is hidden
40%:up:border-bottom positioning on top with a border below the preview window

--bind '?:toggle-preview'

toggles the window with the question mark ?

--preview "if grep -qo Issue <<< {}; then gh issue view {5} -R {3}; elif grep -qo PullRequest <<<{}; then gh pr view {5} -R {3}; else echo \"Move Along, Nothing To See.\"; fi"

It works, but looks a bit messy :worried:
The dummy text "Move Along, Nothing To See." can be removed, but then the window would be empty. I left it in for now as a joke.

GIF

Asciinema
The same as the GIF, but it will be dead within 7 days. I like this better because you can pause the "video" and even copy the commands directly from it. I should create an account there. :grinning:

This is amazing! 🚀
I'll test it out and merge shortly


Add a function tracing decorator

Create a new model of execution for panopticon where it makes it easy to trace inside a specific function without having to worry about how the rest of the project behaves: kind of like tracer bullets to debug how a specific function is being handled.

8b38a82ff8dcfe00d68b5e2311b6ccede0632186, 215ae44a1d7ee0f4f917bedc555e21517ade7f7c, 5aa0a8f184c338f18159b2c8294fbe03e16b5c36, c28b0bc48744a68ff3347ea1d3be964ef4fb5697


[Request Page] After clicking on friend's request card user is not redirected to user's page

Environment: Windows 10, Chrome 114.0.5735.110 (64 bit)
Reproducible: always
Build found: 22.08.23
Preconditions
User has received at least 1 friend request.
Steps to reproduce

Go to GreenCity.
Sign in as User.
Open My Friend page.
Click on Requests page.
Click on friend's request card.

Actual result
User redirects to UBS Page.
Expected result
User redirects to page of user who has sent a request.
User story and test case links
E.g.: "User story #2084
Test case

this is duplicate of this card:
https://github.com/ita-social-projects/GreenCity/issues/6283


Enhanced view with some improvements

Signed-off-by: soniasingla<EMAIL_ADDRESS>Checklist

[x] I have read the Contributor Guide
[x] I have read and agree to the Code of Conduct
[x] I have added a description of my changes and why I'd like them included in the section below

Description of Changes
This PR adds some changes to enhance the view for the users 🌍
Related Issue #52
Further Changes planned

[ ] More projects can be found here will be changed into collapsed section

@lpil @XAMPPRocky need your suggestions here, try running this locally, what are your thoughts after that? 🤗

Tip: There's a preview deployment that can be viewed by clicking this link, so no need to run locally.

The new placement could be good. Keen to see what it looks like as a collapsible section. Gimmie a shout if you'd like some pointers with that

I have some thoughts here, I checked only two projects which are in the category of docker are left which are not included in upper sections, maybe we can add a new section of docker projects? or expand feature sounds better?

There is also this one:

I would prefer an "other" section as a container one would likely not grow any larger, and if we add any future projects that are not Rust, Go, Web, or Containers they will get lost with this system.
Ari said previously they'd like to have the list still so we can browse all of them in one place, which I have found useful previously. https://github.com/EmbarkStudios/opensource-website/issues/52#issuecomment-734269713

Thanks Sonia!


Unable to use custom xc functional

Hi PySCF developers,
I'm new to using PySCF. I wanted to plugin my own XC functional using the define_xc_() interface in the dft module. To begin with, I attempted to run the example that demonstrates the use of custom XC functional (https://github.com/pyscf/pyscf/blob/master/examples/dft/24-define_xc_functional.py). However, running it throws the following error:
Traceback (most recent call last):
  File "custom_xc_test.py", line 63, in <module>
    mf.kernel()
  File "<string>", line 2, in kernel
  File "/home/biku/miniconda3/lib/python3.8/site-packages/pyscf/scf/hf.py", line 1779, in scf
    kernel(self, self.conv_tol, self.conv_tol_grad,
  File "/home/biku/miniconda3/lib/python3.8/site-packages/pyscf/scf/hf.py", line 124, in kernel
    vhf = mf.get_veff(mol, dm)
  File "/home/biku/miniconda3/lib/python3.8/site-packages/pyscf/dft/rks.py", line 80, in get_veff
    n, exc, vxc = ni.nr_rks(mol, ks.grids, ks.xc, dm, max_memory=max_memory)
  File "/home/biku/miniconda3/lib/python3.8/site-packages/pyscf/dft/numint.py", line 1158, in nr_rks
    for i, ao, mask, wv in block_loop(ao_deriv):
  File "/home/biku/miniconda3/lib/python3.8/site-packages/pyscf/dft/numint.py", line 1138, in block_loop
    exc, vxc = ni.eval_xc_eff(xc_code, rho, deriv=1, xctype=xctype)[:2]
  File "/home/biku/miniconda3/lib/python3.8/site-packages/pyscf/dft/numint.py", line 2696, in eval_xc_eff
    out = self.libxc.eval_xc1(xc_code, rho, spin, deriv, omega)
  File "/home/biku/miniconda3/lib/python3.8/site-packages/pyscf/dft/libxc.py", line 1599, in eval_xc1
    out = _eval_xc(xc_code, rho, spin, deriv=deriv, omega=omega)
  File "/home/biku/miniconda3/lib/python3.8/site-packages/pyscf/dft/libxc.py", line 1654, in _eval_xc
    rho = rho.reshape(spin+1,nvar,ngrids)
ValueError: cannot reshape array of size 120224 into shape (1,1,30056)

The custom_xc_test.py is just a copy of the example link provided above.
I used pip install --prefer-binary pyscf to install my PySCF.
I would really appreciate it if you can help me figure out how to use a custom XC functional.
Regards,
Bikash

I can reproduce this error with a new version compiled from source, so it's not the installation. Thanks for reporting the error.

You may use PySCF v5.3. v5.4 has introduced a new convention for the eval_xc function, which is now the eval_xc_eff function that is used by default. This is a backward compatibility issue that should be fixed.


[FLINK-15140][runtime] Fix shuffle data compression doesn't work with BroadcastRecordWriter.

What is the purpose of the change
We implemented shuffle data compression in FLINK-14845 to reduce disk and network IO, but unfortunately, a bug was introduced, which makes the compression doesn't work when broadcast partitioner is used.
For pipelined mode, because the compressor copies the data back to the input buffer, however, the underlying buffer is shared when BroadcastRecordWriter is used. So we can not copy the compressed buffer back to the input buffer if the underlying buffer is shared. For blocking mode, we wrongly recycle the buffer when buffer is not compressed, and the problem is also triggered when BroadcastRecordWriter is used.
This PR tries to fix the problem.
Brief change log

Disable data compression for operators which use broadcast partitioner in pipelined mode.
Not recycle buffer if it not compressed in blocking mode.=

Verifying this change
ShuffleCompressionITCase is modified to cover the scenario.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
The serializers: (yes / no / don't know)
The runtime per-record code paths (performance sensitive): (yes / no / don't know)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes / no / don't know)
The S3 file system connector: (yes / no / don't know)

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

Thanks for the review and comments @zhijiangW @pnowojski . I have updated the PR according to the discussion.

@zhijiangW Thanks for the review. I have updated the PR.

Thanks @zhijiangW @pnowojski for the review.
Do you have any other concerns? @pnowojski

No, I'm fine :)
note for the future, if I haven't "requested changes" (github status), usually I'm fine with not having to formally follow up on my comments, as long as they were addressed :)


Add mappings for normal mode

Currently the plugins only exposes the default mappings for insert mode, I changed it so that they also work in normal mode.

Done


Request Onboarding to OSC Data Commons

Requesting onboarding for github user: yoann-diep
Request access to github team: <team-name(s)>
View teams here: https://github.com/orgs/os-climate/teams
Onboarding resources:

Data Commons environment setup
credentials.env file

Onboarding checklist:

[x] new user invited to os-climate github org
[x] user invited to requested teams

Welcome @yoann-diep!  I invited you to our github.  This is a great resource in helping you get on-boarded: https://github.com/os-climate/OS-Climate-Community-Hub/blob/main/README.md.  Please let me know if you need any help.


Unirest doesn't automatically store cookies to send them on subsequent requests

I'm submitting a GET request with Unirest to my server.
The url of this GET request contains a token (it is needed to authorize the request). The server checks if this token is in the session, if it is the request is authorized.
The problem is that if I submit the request with Unirest the request is unauthorized.
If I take the same url, with the same token, and I submit this url to the browser, the request is authorized and the response is returned.
It's like Unirest makes some manipulation on the url string.
Do you have some clue to explain this behaviour?

hoping that #47 will take care of this, will check again after that PR is updated with new code structure.


MAPL3 Time Averaging

Types of change(s)

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Trivial change (affects only documentation or cleanup)
[ ] Refactor (no functional changes, no api changes)

Checklist

[ ] Tested this change with a run of GEOSgcm
[ ] Ran the Unit Tests (make tests)

Description
MAPL3 needs a time averaging capability, including mean, max, and min, using coupler to compute a time average from a source (import) field to destination (export) field.
Related Issue

This is very much a work in progress.

I pushed my suggested form with the base class and the subclasses with overloads and additional procedures. I'm debugging now.
Also, it includes changes to FieldPointerUtilities.F90 that I planned to use, but I did not. I left them in there because they still make sense. See FieldsHaveUndef, FieldHasUndef, GetFieldsUndef, and GetFieldUndef.

Still seems to be in a very drafty state.
I recommend that at some point soon you create a new branch off of release/MAPL-v3 and copy your latest version there. The history of commits is an unecessary burden to merge. (And then create a new PR.)

I suppose we could try enabling "squash and merge" for MAPL3? Then it would be one commit.

Still seems to be in a very drafty state.
I recommend that at some point soon you create a new branch off of release/MAPL-v3 and copy your latest version there. The history of commits is an unecessary burden to merge. (And then create a new PR.)

I suppose we could try enabling "squash and merge" for MAPL3? Then it would be one commit.

If it works that is fine.   I'm expecting conflicts.  And at that point it's probably easier to just do a new branch.

All tests pass for AccumulatorAction.F90. Still working through comments/changes.

I'll create a new PR when the additional tests for Mean and Min/Max are complete and passing, but before adding support for ESMF_KIND_R8.

Do not delete branch. It is still needed. I will create a new branch when it is time for new PR.


Rework GameCube controller support

Extracted from https://github.com/DragonMinded/libdragon/pull/215#issuecomment-955559468
While reviewing the controller subsystem routines for GameCube controllers to update the Doxygen comments, I have collected some notes concerning the usefulness and ergonomics of the current implementation:

Players that want to use a GameCube controller on N64 will need to make a passive GCN->N64 controller adapter for each controller in order to use it.

GameCube controllers do not identify as N64 controllers, use separate Joybus commands, and have a completely different data structure, so commercially-available GCN->N64 adapters actively convert the Joybus commands for compatibility with existing Nintendo 64 software.
The use-case for using GameCube Joybus commands on a Nintendo 64 is extremely esoteric and was never supported by Nintendo or any third-party.

controller_read_gc and controller_read_gc_origin are not integrated with the rest of the controller subsystem.

A developer would need completely separate controller-handling code-paths to support GameCube controllers.

struct controller_data is wasteful, confusing, and unnecessary:

You will never get N64 and GCN controller data in the same result, so half of the struct is always padding.

I don't necessarily think we should remove the GC controller commands completely, but I think they need to be removed from the rest of the controller subsystem and flagged as highly-experimental if it even makes sense to keep it at all.
I strongly doubt that any developer except the original author is actually using these GC controller functions, so it might make sense to deprecate them and rework the developer experience (or just remove them entirely). Right now the usage is a lot of pain for very little gain.

Linking this with #48 where GameCube controller support was introduced

This project is using the GameCube controller support functions: https://github.com/clbr/n64gctest

Pinging @clbr to get some more context on the intentions of this functionality and what the impact of deprecation/rework would be for their projects.

Linking to the n64-dev Discord discussion about GC controllers on N64: https://discord.com/channels/205520502922543113/205520502922543113/903630132294611044

I cannot see that discord discussion, please post it on pastebin or here. Further, I'm appalled at your approach in general; "this homebrew is doing new, exciting things that no released software did - therefore we must remove it". Seriously, WTF?

The use case of GC controllers on N64 is extremely useful, and extremely positive PR for any title exactly because it was never supported by Nintendo. The compatibility of the two consoles' controller buses must be used to do interesting things.
Duh. The GC controllers have a different button layout - of course it requires different code paths! You cannot expect one stick and two sticks to share the same moving code.
Separate the structs if you feel like it.

"Right now the usage is a lot of pain for very little gain." It is very easy and provides something excellent that Nintendo itself never provided.

what the impact of deprecation/rework would be for their projects.
This gets political, but the impact would be zero for two reasons.

the author of libdragon started accepting poor quality PRs at one point, severely reducing the library's quality and forcing me to review each commit manually
the author of libdragon took a political stance I do not agree with (SJW naming of the branches); I want nothing to do with any project that does this

For these two reasons, I am already using a private fork, and will continue to do so. So if you want to remove this functionality because no current libdragon user makes use of it - despite the obvious pluses to allowing projects to use a better controller with two sticks - go ahead.

 Go to your fork, don't come back here.   We don't need people like you that make a huge fuss about a branch rename to stay inclusive, nor do we need people who want to take it upon themselves to trash other user contributions because it doesn't hold up to their personal standards. Go away.

I was asked to comment, and I kept my comment respectful. Unlike you.

Closing this. Sorry, I did not realize I was opening a can of worms here. I just want to make cool stuff for the Nintendo 64.
I think GameCube controller support in LibDragon is an interesting feature, and I want to help make it more accessible. To that end, I think the best path forward for GC support would be:

Document the required passive GC->N64 controller adapter. It's really simple, but it's not documented.
Move the raw GC controller code out of the controller subsystem into a separate gc_controller module.
Attempt to integrate GameCube controllers with the LibDragon controller subsystem so that everyone gets basic GC->N64 controller support "for free".

There's a chicken-and-egg problem here with the adapters: no one has an adapter because no games support it, and no games support it because no one has the adapter. My hope is that if GC controller support in LibDragon is better-documented and "just works", then more people will make/sell these passive adapters.
The concession with "for free"/"just works" support is that there are more inputs on a GC controller than N64, so mapping GC data to the N64 controller struct means losing X and Y and crushing the C-stick down to 4 buttons. Developers who wants to go the extra mile could still detect the GC controller and use the raw commands, just like how things work currently.

Update: I have created a working draft for a next-generation joypad subsystem that abstracts and unifies N64 and GameCube controller handling: https://github.com/meeq/JoypadTest-N64


Please build ipa for tvOS

I can sign it later.

hey @denisoster , sorry, but there are no artefacts will be provided for that project


Set Sinatra’s root to Adhearsion’s root

This makes Sinatra properly serve “#{Adhearsion.root}/public” as the public files folder

LGTM

Coverage increased (+0.01%) to 98.221% when pulling f156f9d4c56dbfddf1d47633ebb56669e5c5c75e on feature/tweak_default_sinatra_config into 2cf78dc3b416fa4eebd759427143ccb3181c7f33 on develop.


Add ability to create Yt::Video from an embed url.

Reference issue #210

@jacknguyen Perfect. :ribbon:
Can you also add a line to the changelog, specifying version 0.25.1 - unreleased in the header?
Then merge in the previous commit. Thanks!


Ubuntu:  getting a string instead of samples in data event.

My app works perfectly on my mac.  When I run it on my ubuntu machine (my actual target) the 'data' event returns strings instead of samples.
I've tried it with a couple of different USB microphones.  Here's an example of a message that is coming through the 'data' callback:
re/alsa/alsa.confommon:CARD=0,DEVICE=3,CTLINDEX=0,AES0=4,AES1=130,AES2=0,AES3=2m
What's causing this?  I am able to record on this PC using arecord, so it appears ALSA is working in the system.

Update:  appears to be related to asking for a sample format that the hardware doesn't support.  Not sure why this isn't an error instead of passing messages through the data event.

Maybe more data on the environment might help:
Ubuntu 18.04 64-bit server running on a celeron x86 CPU.
There is no native audio hardware on this device; I'm using USB microphones.
I installed alsa using apt.  Appears to be version 1.1.3.
What other info would be helpful?

I have just pushed a big update to naudiodon. It would be good to know if the new implementation still has this problem.


[WIP] Add Assert Compile to Controller Tests

#fixes 253

Pull Request Test Coverage Report for Build 2060

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 89.17%

Totals

Change from base Build 2045:
0.0%

Covered Lines:
494

Relevant Lines:
554

💛  - Coveralls


Add *.exe as binary to .gitattributes in Template

This is to ensure Git knows to treat *.exe files as binaries:
* text eol=crlf
*.exe binary

Bump. Still on my plate.

That one should probably be transferred to DscResource.Template?

Done: https://github.com/PowerShell/DscResource.Template/issues/12


[BUG] Text similarity cannot be computed using embeddings

Describe the problem
After computing embeddings using the model clip-vit-base32-torch, if I compute similarity using these embeddings, image similarity is calculated instead of text similarity. However, if I use the model directly in the compute_similarity() function, text similarity is computed.
This means that if I add new images to a dataset, I have to recompute both the embeddings and similarity for all the images. Instead I would like to just compute embeddings for the new images and then compute text similarity for all the images.
Code to reproduce issue
import fiftyone as fo
import fiftyone.brain as fob
import fiftyone.zoo as foz

dataset = foz.load_zoo_dataset("quickstart")
model = foz.load_zoo_model("clip-vit-base32-torch")

dataset.compute_embeddings(
    model, embeddings_field="clip_embeddings"
)

image_index = fob.compute_similarity(
    dataset, embeddings="clip_embeddings", brain_key="text_sim_clip"
)

assert image_index.config.supports_prompts

System information

OS Platform and Distribution : Linux Ubuntu 22.04
Python version : 3.10.12
FiftyOne version : 0.25.0
FiftyOne installed from: pip

Willingness to contribute
The FiftyOne Community encourages bug fix contributions. Would you or another
member of your organization be willing to contribute a fix for this bug to the
FiftyOne codebase?

[ ] Yes. I can contribute a fix for this bug independently
[ ] Yes. I would be willing to contribute a fix for this bug with guidance
from the FiftyOne community
[x] No. I cannot contribute a bug fix at this time

Hi @sanjeev-sudarsan 👋
You can declare the model that was used to generate the precomputed embeddings by including the model="clip-vit-base32-torch" parameter in addition to embeddings= like so:
Now the similarity index supports text similarity while avoiding recomputing the embeddings when compute_similarity() is called:
import fiftyone as fo
import fiftyone.brain as fob
import fiftyone.zoo as foz

dataset = foz.load_zoo_dataset("quickstart")
model = foz.load_zoo_model("clip-vit-base32-torch")

dataset.compute_embeddings(model, embeddings_field="clip_embeddings")

image_index = fob.compute_similarity(
    dataset,
    model="clip-vit-base32-torch",  # declare model that was used
    embeddings="clip_embeddings",
    brain_key="text_sim_clip",
)

# Now works!
assert image_index.config.supports_prompts

Regarding adding new samples, you can achieve this like so:
import fiftyone as fo
import fiftyone.brain as fob
import fiftyone.zoo as foz

dataset = foz.load_zoo_dataset("quickstart")
model = foz.load_zoo_model("clip-vit-base32-torch")

view1 = dataset[:100]
view1.compute_embeddings(model, embeddings_field="clip_embeddings")

image_index = fob.compute_similarity(
    dataset,
    model="clip-vit-base32-torch",  # declare model that was used
    embeddings="clip_embeddings",
    brain_key="text_sim_clip",
)

# Now works!
assert image_index.config.supports_prompts

print(image_index.total_index_size)  # 100

view2 = dataset[100:]
view2.compute_embeddings(model, embeddings_field="clip_embeddings")

image_index.reload()

print(image_index.total_index_size)  # 200

The above assumes you're using the default sklearn backend. If you're using another backend (say pinecone), then you'll need to use add_to_index() to add the new embeddings to the index as described here:
https://docs.voxel51.com/brain.html#adding-embeddings-to-an-index


Update vue basic example link to v5

v4 was showing "Initializing Sandbox Containe" forever, so i tried to update link to v5, and it works fine.

it works fine for me now. could've been an upstream issue with codesandbox. linking to v5 is definitely not correct, as that version is currently in alpha.


fix: compile errors when using WiFiManager.h on ESP8266

Hi @ph1p I figured out a way to fix the build errors when using WiFiManager on ESP8266.
I don't have a device at hand right now, so I couldn't test it.

So it's correct, that you revert your PR https://github.com/ph1p/ikea-led-obegraensad/pull/59 ?

Not at all. #59 was limited to ESP32 and for ESP8266 we kept the "legacy" way of connecting to WiFi. I've solved the compile errors on ESP8266, so we can start using WiFiManager there as well.
Looking at the changes again, I realize I should add another commit with an updated README.

But this PR removes your previous code. So you have to check if its ESP32 or ESP8266. This repository does not have branches for every board. The code should work for both and handle it via #define ....

No it consolidates my code. Previously, we had two versions of connectToWifi(), one defined for ESP32, one for ESP8266. Now we only have one. That's why the diff is so large. Please check the entire file here: https://github.com/ph1p/ikea-led-obegraensad/blob/a875e5cdeb9cc76f498b6aecf333e1235b065577/src/main.cpp#L52-L77
Am I missing something?


Blitz got rid of the graphql endpoint we were using. Swapped it to lo…

…lalytics
Will add more functionality later but right now it gets the stats of the main role of every champ

Looks like champion is back up, so let's keep using that.


Code repetition with header, footer, scripts and stylesheets

In the current project setup, we have a significant amount of repeated code across multiple HTML pages, particularly with the header and footer sections. This redundancy not only makes the codebase larger but also complicates maintenance and future updates.
in order to solve this I suggest making a script that dynamically loads a "component" by making header, footer and any other reused code into components that can be dynamically added into any page when needed this will give us advantages like only editing the component to update across all pages.
Why Dynamic Loading Logic is Beneficial for Our Project
Implementing dynamic loading logic for components allows us to address these issues effectively. Here are the key reasons for adopting this approach:
1. Elimination of Code Duplication

Remove code repetition: By creating reusable header and footer components, we adhere to the DRY principle. This reduces the amount of duplicated code across different HTML pages, making it easier to manage.
Centralized Updates: When changes are needed (e.g., a new logo or footer links), we can update the component once rather than having to modify multiple files. This minimizes the risk of errors and ensures consistency across the application.

2. Improved Maintainability

Easier Maintenance: With the header and footer defined as components, developers can make updates without having to navigate through multiple HTML files. This simplifies maintenance and allows for faster iterations.
Clear Structure: Organizing the code into components creates a clearer structure, making it easier for new developers to understand how the application is built and where to find specific pieces of code.

3. Enhanced Development Efficiency

Faster Development: Developers can create and integrate new components quickly with a simple function call. This speeds up the development process and allows for more rapid feature implementation.
Focus on Logic Over Redundancy: Instead of repeatedly writing similar HTML for headers and footers, developers can focus on the unique logic and functionality of each page, improving overall productivity.

4. Consistent User Experience

Uniformity: Using dynamic loading for common components ensures that the header and footer appear consistently across all pages, providing a cohesive user experience. Any updates to these components are immediately reflected everywhere they are used.

5. Future Scalability

Easier to Add New Components: As the project grows, it will be easier to add new components or templates by simply defining them and using the loading logic. This scalability supports ongoing development without requiring significant restructuring.

Example Usage
what I have in mind for fellow devs is to have access to something like this
<script src="/scripts/componentLoader.js"></script> // the script that holds the dynamic loading logic
<script>
    prependComponent('Navbar');
    prependComponent('ScrollToTop');
    appendComponent('Footer');
</script>

the functions also have a default parameter for target Element so by default the component is added into the body tag but you can also specify an element thus increasing the functions versatility and adding a new element of dynamic loading to the project
Conclusion
By implementing dynamic loading logic for our header, footer, and other common components, we can significantly improve our project's maintainability, efficiency, and scalability. This approach not only adheres to best practices in web development but also enhances the overall quality of our codebase, making it easier for the team to collaborate and innovate moving forward.

I have already implemented the logic and refactored the code, you can see that here: https://github.com/jaison-jai-john/Pathsphere/tree/issue-%23215
if assigned I can make the PR as soon as possible.
NOTE: the file structure is based on the PR and accepted for issue #189

Create a new pull request

@aditya-bhaumik i have opened the pull request #219


[dialog] Test sometimes locked on Python 2.7

Must be investigated
This test never ending (time to time). The process must be killed manually. Maybe due to an infinite while on tests.
python run_tests.py --installed -vv silx.gui.dialog.test.test_imagefiledialog.TestImageFileDialogInteraction.testClickOnBackToRootTool

Well, still deadlock sometimes...

I am afraid QTest.qWaitForWindowShown (Qt4) is not using a timeout, while QTest.qWaitForWindowExposed (Qt5) is using a timeout. The Qt4 version wait for event... No?

That's maybe still a problem with network drivers... Boring...

That's it. It is deadlocking before qWaitForWindowExposedAndActivate... Maybe because of network drivers...

Problem found and fixed for the release 0.7. An instance of QFileDialog was created to custom user shortcuts. It is now disabled on Windows PyQt4.


Social card

This course needs a social card. @a-a-ron do you have bandwidth to help with this?

Thanks! Added.


Ionicons conditional import does not work

Short description of the problem:
In components.core.scss the following conditional import does not work.
$ionicons: true !default;
@if ($ionicons) {
  @import "fonts/ionicons";
}

In both cases $ionicons true or false fonts/ionicons will be imported.
What behavior are you expecting?
When $ionicons is false fonts/ionicons should not be imported.
Steps to reproduce:

Overwrite $ionicons to false
Re compile Sass
Check that the file is still imported

Which Ionic Version? 2.x

Thanks for the issue! This should be fixed by https://github.com/driftyco/ionic/commit/219059c5b0682365f6bdf243eaf4cd47c611f175 in the latest release.

(Wo)Man i was just searching for this before making an issue, glad it's fixed for next release, however which version is that?

@Luchillo It should be fixed in the beta.6 release. :)

Yep, just updated all my deps and it works. 😄