[Bug]: Opensearch Serverless throwing compile error when trying to filter using MetadataFilter object

Bug Description
Hello I am running into an odd situation where when I try to connect up to opensearch serverless in AWS and attempt to filter on some metadata, in my case a field called index_type, it returns the following error RequestError: RequestError(400, 'search_phase_execution_exception', 'compile error')
I spent some time pulling out the OpensearchVectorClient and OpensearchVectorStore classes since I didnt see a good way to extract the query it was producing, but once I did and logged the query it generated this is what it attempts to build which is breaking. I also ran this query directly against opensearch-py library and got the same error as above so I am guessing the query being generated is incorrect some how. If I just do a basic "scan" query and filter on the metadata.index_type.keyword field it returns fine but the llamaindex generated query seems off.
Here is the query it generates before it attempts to query Opensearch serverless under the hood. I removed the values in the embedding field to save on screen real estate. the following query is the one that creates that compile error.
{'size': 6, 'query': {'script_score': {'query': {'bool': {'filter': [{'bool': {'must': [{'term': {'metadata.index_type.keyword': 'smart_chunk'}}]}}]}}, 'script': {'source': "1/(1.0 + l2Squared(params.query_value, doc['embedding']))", 'lang': 'painless', 'params': {'field': 'embedding', 'query_value': []}}}}}
But this gets weirder when I modify the Metadatafilter key values to be metadata.index_type instead of just index_type it produces the following query which then runs fine but doesnt return any results, due to it not finding anything to match that filter I assume.
{'size': 6, 'query': {'script_score': {'query': {'bool': {'filter': [{'bool': {'must': [{'term': {' metadata.metadata.index_type.keyword': 'smart_chunk'}}]}}]}}, 'script': {'source': "1/(1.0 + l2Squared(params.query_value, doc['embedding']))", 'lang': 'painless', 'params': {'field': 'embedding', 'query_value': []}}}}}
I am at a loss as to best sort out where in the query it is wrong, need to get better at understanding OS query language, or if its something about the index? we used llamaindex to create the index so I would have assumed that was taken care of correctly under the hood there. Any thoughts or ideas? Also why is the OpensearchClient Async only? I cant seem to be able to run the client under a fastapi service layer due to event loop issues, but I can deal with that later.
Version
0.10.68
Steps to Reproduce
Here is the code that tries to call the vector store and retrieve results from opensearch
vector_store = OpensearchVectorStore(client=self.vector_client)
index = VectorStoreIndex.from_vector_store(vector_store)
smart_chunk_filters = MetadataFilters(
   filters=[
       MetadataFilter(key="index_type", value="smart_chunk"),
   ]
)
query_engine = index.as_retriever(similarity_top_k=k, filters=smart_chunk_filters)
node_postprocessors = MetadataReplacementPostProcessor(
   target_metadata_key="window"
)
result = query_engine.retrieve(query)

Relevant Logs/Tracbacks
backend-1  | opensearchpy.exceptions.RequestError: RequestError(400, 'search_phase_execution_exception', 'compile error')

@dosu I still get the same error when adding the operator field. opensearchpy.exceptions.RequestError: RequestError(400, 'search_phase_execution_exception', 'compile error')

@dosu here is the AWS Opensearch query from the logs I have I think it is trying to build and throwing the error with. I shortened the query_value field to just a few floats for brevity.
{'size': 6, 'query': {'script_score': {'query': {'bool': {'filter': [{'bool': {'must': [{'term': {'metadata.index_type.keyword': 'smart_chunk'}}]}}]}}, 'script': {'source': "1/(1.0 + l2Squared(params.query_value, doc['embedding']))", 'params': {'field': 'embedding', 'query_value': [-0.11328125, -0.072753906, 0.36523438]}}}}}

@dosu I do not think that is it.  the query you produced is the same as the one I posted just with a few extra white spaces. I tried to copy it in my query just to be sure but still errored. here is the query I tried.
{'size': 6, 'query': {'script_score': {'query': {'bool': {'filter': [{'bool': {'must': [{'term': {'metadata.index_type.keyword': 'smart_chunk'}}]}}]}}, 'script': {'source': "1 / (1.0 + l2Squared(params.query_value, doc['embedding']))", 'params': {'field': 'embedding', 'query_value': [-0.11328125, -0.072753906]}}}}}

@dosu I made the changes suggested yet it still generates the following query for AWS Opensearch and throws a compile error like so.
backend-1  |   File "/usr/local/lib/python3.11/site-packages/opensearchpy/client/utils.py", line 176, in _wrapped
backend-1  |     return func(*args, params=params, headers=headers, **kwargs)
backend-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
backend-1  |   File "/usr/local/lib/python3.11/site-packages/opensearchpy/client/__init__.py", line 2364, in search
backend-1  |     return self.transport.perform_request(
backend-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
backend-1  |   File "/usr/local/lib/python3.11/site-packages/opensearchpy/transport.py", line 455, in perform_request
backend-1  |     raise e
backend-1  |   File "/usr/local/lib/python3.11/site-packages/opensearchpy/transport.py", line 416, in perform_request
backend-1  |     status, headers_response, data = connection.perform_request(
backend-1  |                                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^
backend-1  |   File "/usr/local/lib/python3.11/site-packages/opensearchpy/connection/http_requests.py", line 238, in perform_request
backend-1  |     self._raise_error(
backend-1  |   File "/usr/local/lib/python3.11/site-packages/opensearchpy/connection/base.py", line 315, in _raise_error
backend-1  |     raise HTTP_EXCEPTIONS.get(status_code, TransportError)(
backend-1  | opensearchpy.exceptions.RequestError: RequestError(400, 'search_phase_execution_exception', 'compile error')

Here is the query that was generated by LLamaindex code
{'size': 6, 'query': {'script_score': {'query': {'bool': {'filter': [{'bool': {'must': [{'term': {'metadata.index_type.keyword': 'smart_chunk'}}]}}]}}, 'script': {'source': "1 / (1.0 + l2Squared(params.query_value, doc['embedding']))", 'params': {'field': 'embedding', 'query_value': [-0.11328125, -0.072753906, 0.36523438]}}}}}

Here is a schema of the index I am trying to run against. Is there something wrong with the setup of the index or could it be the generation of the query?
{'test-index': {'mappings': {'properties': {'content': {'type': 'text',
     'fields': {'keyword': {'type': 'keyword', 'ignore_above': 256}}},
    'embedding': {'type': 'knn_vector',
     'dimension': 1536,
     'method': {'engine': 'faiss',
      'space_type': 'l2',
      'name': 'hnsw',
      'parameters': {}}},
    'id': {'type': 'text',
     'fields': {'keyword': {'type': 'keyword', 'ignore_above': 256}}},
    'metadata': {'properties': {'_node_content': {'type': 'text',
       'fields': {'keyword': {'type': 'keyword', 'ignore_above': 256}}},
      '_node_type': {'type': 'text',
       'fields': {'keyword': {'type': 'keyword', 'ignore_above': 256}}},
      'doc_id': {'type': 'text',
       'fields': {'keyword': {'type': 'keyword', 'ignore_above': 256}}},
      'document_id': {'type': 'text',
       'fields': {'keyword': {'type': 'keyword', 'ignore_above': 256}}},
      'index_type': {'type': 'text',
       'fields': {'keyword': {'type': 'keyword', 'ignore_above': 256}}},
      'original_text': {'type': 'text',
       'fields': {'keyword': {'type': 'keyword', 'ignore_above': 256}}},
      'ref_doc_id': {'type': 'text',
       'fields': {'keyword': {'type': 'keyword', 'ignore_above': 256}}},
      'window': {'type': 'text',
       'fields': {'keyword': {'type': 'keyword', 'ignore_above': 256}}}}}}}}}

@dosu According to Opensearch docs that is not correct.

@dosu I am already doing that and still am getting compile error from aws opensesarch serverless. We have come full circle. Can someone else chime in possibly? I have also rebuilt the index using llamaindex defaults and no luck. there was an update 2 weeks ago to try to handle filters better but I am curious how it was tested becasue it really does seem like the query being generated is wrong somehow. if I remove the function called in score_script and just use knn score it works fine.

to add more context I am also trying the query generated by llamaindex code directly against opensearch-py standalone and getting these same errors

Ok figured out its due to opensearch serverless not supporting that function type. I will put in a PR to better support Opensearch Serverless since the default query thats generated seems to assume full query language support and uses l2squared.


adds documentation for getting start with the scaffolder

ch4365

How do I create a demo page. Ive seen people linking them.

I see the link is in the deploy-preview check. :)


OCPBUGS-28225: pkg/storage/s3: enable bucket key on encryption settings

using this setting enables a key to be used for the entire bucket instead of AWS creating one key per object.
for more info see
https://docs.aws.amazon.com/AmazonS3/latest/userguide/bucket-key.html.

testing
setting up your environment

create a cluster (don't use cluster-bot unless you can access the AWS console for it)
create a KMS key (use the defaults)
copy the key id (ARN)
add the registry IAM users to the list of users in your KMS key (if you skip this step you will get 500 Internal Server Error from the registry when you try to push images!)
edit the operator config and set .spec.storage.s3.keyID to your key id,
mine was "arn:aws:kms:ap-northeast-1:942491940283:key/da77a03c-692e-497d-bef6-d5da91e50f58", yours will be different.

verify it works

verify that the bucket "Bucket Key" is "Enabled" by going to the bucket on AWS console
under the "Properties" tab, look for "Default encryption"
the last field under "Default encryption" is "Bucket Key" - make sure it says "Enabled" under it

this PR enables bucket key for all types of encryption (SSE:KMS and SSE:S3) so
please also verify that only encrypt: true works (without specifying a keyID, this will use SSE:S3)

/assign @dmage

this is for ROSA - we want to backport it all the way to 4.13.
we'll start with 4.15.z.
/cherry-pick release-4.15

/lgtm

/cherry-pick release-4.15

/label qe-approved

/hold cancel

/test all


Test

test

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 74dc7cef-39ea-97d2-2d82-a88da090cbc4
Version Independent ID: fe858571-6f3c-1b2e-e229-a7037a82508d
Content: JavaScript single-page app scenario - Microsoft identity platform
Content Source: articles/active-directory/develop/scenario-spa-overview.md
Service: active-directory
Sub-service: develop
GitHub Login: @navyasric
Microsoft Alias: nacanuma

Test


usage tracking code - Cloudera specific

Internal Ticket: https://jira.cloudera.com/browse/DBT-68
This is a small piece of code that will anonymously track any open connection events with the dbt-impala adapater.
The data is sent to a Cloudera controlled snowplow endpoint using simple HTTPS request. No user identifiable information is sent.
Tracking is enabled by default, to disable tracking for your project profile.yml, set usage_tracking to False.

Testing for this PR must include a case where dcevents.cldrteam.datacoral.io is blocked/unreachable. We should not degrade performance/experience where tracking is enabled, but the endpoint is unreachable.

Testing for this PR must include a case where dcevents.cldrteam.datacoral.io is blocked/unreachable. We should not degrade performance/experience where tracking is enabled, but the endpoint is unreachable.

This is updated to make the request call to datacoral endpoint non-blocking

@geethamurthy changed to prod key and endpoint


[RFC]: Explore concept of global imports for components

Which scope/s are relevant/related to the feature request?
Don't known / other
Information
In most cases, when building Angular components, there are some directives/pipes that you end up using over and over such as:

NgIf
NgFor
Async Pipe

The concept of global imports would make these imports implicitly available by default by adding them to an imports.ts file defined in the project that is added to the imports array of all components/directives. There would be some way to opt-out of this behavior also.
BEFORE:
import { AsyncPipe, CurrencyPipe, NgForOf } from '@angular/common';
import { Component, inject, OnInit } from '@angular/core';

import { Observable } from 'rxjs';
import { CartService } from '../../cart.service';

@Component({
  selector: 'app-shipping',
  standalone: true,
  imports: [NgForOf, CurrencyPipe, AsyncPipe],
  template: `

Shipping Prices

      {{ shipping.type }}
      {{ shipping.price | currency }}

  `,
})
export default class ShippingComponent implements OnInit {
  private cartService = inject(CartService);

  shippingCosts!: Observable<{ type: string; price: number }[]>;

  ngOnInit(): void {
    this.shippingCosts = this.cartService.getShippingPrices();
  }
}

AFTER:
src/imports.ts
import { AsyncPipe, CurrencyPipe, NgForOf } from '@angular/common';

export const imports = [
  AsyncPipe,
  CurrencyPipe,
  NgForOf,
  // other imports
];

import { Component, inject, OnInit } from '@angular/core';

import { Observable } from 'rxjs';
import { CartService } from '../../cart.service';

@Component({
  selector: 'app-shipping',
  standalone: true,
  imports: [
    // global imports included
  ],
  template: `

Shipping Prices

      {{ shipping.type }}
      {{ shipping.price | currency }}

  `,
})
export default class ShippingComponent implements OnInit {
  private cartService = inject(CartService);

  shippingCosts!: Observable<{ type: string; price: number }[]>;

  ngOnInit(): void {
    this.shippingCosts = this.cartService.getShippingPrices();
  }
}

Implementation-wise this would most likely be done with a TypeScript transformer.
Notes

Language service integration?
More flexible imports file?

Describe any alternatives/workarounds you're currently using
Tooling
I would be willing to submit a PR to fix this issue

[ ] Yes
[ ] No

I think I would rather just use Angular Modules over magic app-wide configuration with a non-Modules workaround injecting code into my standalone components?
It feels counter-intuitive to use standalone modules and then say you want an external module to handle common imports.
Component({   selector: 'app-shipping',   standalone: true,   imports: [     ...CommonImports,     ...FeatureImports,     // Component's imports   ],
I understand it's opt-in rather than out, but auto import or code generation options should make that pretty cheap.
It feels like it solves the same issue, just explicitly.  You can always just make the import arrays globally available if you don't want the extra imports in the component files?
The opt-out question on this feels like it's going to make things uglier of you ever don't want the magic globals for some reason.
Plus you're losing some portability.  If you're sharing code with a friend informally across different repos, y'all would have to compare and manage different globals?

It could be too much magic. What I want is a set of things to be available without me importing anything.
Standalone components are great. They've also made Angular even more verbose unless you use arrays for common imports. We don't have a defined pattern for that yet.
The talk at ng-conf by Pawel mentioned something similar using template syntax but I imagine it's going to be bound to first-party directives.
If you're using Analog, you're opting for this potential feature, so if you want to stop using it, there is a cost to switch.
Opt-out could be some sort of filter.

This looks like a lot of effort for almost zero or even negative benefit. The Angular language service would need to be extended to support this in tooling, and it probably won't work in IntelliJ since they use their own version of it. This RFC doesn't address unit testing either.
What is so hard about doing this?
import { AsyncPipe, CurrencyPipe, NgForOf } from '@angular/common';

export const COMMON = [
  AsyncPipe,
  CurrencyPipe,
  NgForOf,
  // other imports
];

import { Component, inject, OnInit } from '@angular/core';

import { Observable } from 'rxjs';
import { CartService } from '../../cart.service';
import { COMMON } from './imports'

@Component({
  selector: 'app-shipping',
  standalone: true,
  imports: [
    COMMON // "global" imports
  ],
  template: `

Shipping Prices

      {{ shipping.type }}
      {{ shipping.price | currency }}

  `,
})
export default class ShippingComponent implements OnInit {
  private cartService = inject(CartService);

  shippingCosts!: Observable<{ type: string; price: number }[]>;

  ngOnInit(): void {
    this.shippingCosts = this.cartService.getShippingPrices();
  }
}

This is then easily sharable with unit tests as well.
import { COMMON } from './imports'

beforeEach(() => {
  TestBed.configureTestingModule({
    imports: [COMMON]
  })
})

@antischematic it says "Explore" in the title for a reason. It may be unreasonable to do in practice, but we may end up with something more suitable as a result. If you have any suggestions other than "do what we've always done" I'd be happy to hear it.

The idea is nice. I know sth like this from ASP.NET. However, as we get Auto Imports for Standalone Components soon, perhaps we don't need such global deps. Or do I miss sth. here?


Delete key-value entries from backend if possible

Both lock and seed-node entries get a TTL after which they expire at the backend. Given this, there is no attempt at the codebase to delete them when it is actually allowed. These cases would be:

Lock entries can be deleted when single cluster node has successfully joined cluster and added itself to the backend.
Seed node entries can be deleted when a node is gracefully leaving the cluster.

While not deleting these entries does not create some catastrophic failure (since they will eventually expire), they do have some annoying side effects:

I have happened to experience the generation of a huge amount of occurences of the log message Couldn't acquire lock, going to GettingNodes due to the existence of a lock that could have been released, but has just been left to expire (the reason becomes more frequent in the context of #168)
Newcomers to the cluster will have to wait for a whole TTL to join successfully in the case that previously existing nodes have just exited the cluster. (assuming #168 will be addressed)

My suggestion would be to add two extra methods on the Coordination trait:

unlock
removeSelf

with default implementations that would do nothing (to keep backwards compatibility) and that would attempt to delete lock and seed node entries respectively on a best effort basis. This means that the ConstructrMachine would fire & forget these commands so as not to make the FSM code any more complex. In the best case, firing these commands will achieve the desired results and in the worst one, nothing changes compared to how the FSM works at the moment.
As mentioned at #168 this is one of the improvements my team would need in the context of our work, which of course we will be more than happy to contribute via PR. Your thoughts?

Interesting. I don't have time to work on ConstructR these days, but a PR would be appreciated.

That is great. Would you mind having a look at #168 as well, to see if you agree (in general) with the proposed solution?

Hi, this seems to be related to #167 and its corresponding PR #169, being removeSelf the equivalent of close. I'd appreciate some feedback on it :nerd_face:


How to set initial positions for elements

I would like to have element initially out of the viewport before animating it inside the view with snabbt. In jQuery, I would do that by setting top: -200px; rule initially for the element, and animating top to 0.
Since snabbt uses transforms, what would be the correct way to set the initial positions?

You could set transform: translateY(-200px); on the element initially. That transform will be overwritten as soon as the snabbt-animation starts. Then use fromPosition to make sure it starts from the same position.
snabbt(element, {
  fromPosition: [0, -200, 0]
});

Thank you!


Correct statements that are no longer true in 1.1

1.1 throws on scalar subqueries that return multiple rows.

Thanks!


Override CSS class for atNavButton

I use atNavButton in a custom designed navigation sidebar, and the button's current appearance doesn't fit. I understand it's possible to override appearance directly in CSS, but I'd love to define custom class for this button, just like
{{> atNavButton class="btn btn-block my-custom-super-nav-button-class"}}

Does this feature already exist or has it been scheduled?

Hi @taxigy,
the configuration options to easily change classes for templates' elements will enter v2.0 but for now you can simply override the template using aldeed:template-extension.
This is the latest comment about this, but you can also have a look at #212.


Complexe association filtering

Hi,
First of all, good job this amazing gem.
I need to do a complexe filtering through an association, but i didn't find any way to make it work as i want. I don't know if it's possible to do this. I explain my problem:
I have an "Announces" model that contains relationship to another model "Characteristics" Through table "Announces_Characteristcs".
"Announces_Characteristics" contain an integer field named "value".
I need to make a range search to value for each characteristics like this:
Announces..search params[:q], :with: {
   (:characteristic_value => 0..100 AND :characteristic_id => 15 )
   AND
  (:characteristic_value => 50 AND :characteristic_id => 16)
  #etc...
}

Heres my models
class Announce < ActiveRecord::Base
  has_many :announces_characteristics
  has_many :characteristics, through: :announces_characteristics
end

class Announce < ActiveRecord::Base
  has_many :announces_characteristics
  has_many :characteristics, through: :announces_characteristics
end

class AnnouncesCharacteristic < ActiveRecord::Base
  belongs_to :characteristic
  belongs_to :announce
 # Value is in this model
end

class Characteristic < ActiveRecord::Base
end

Is it possible to do something like this?

May be it's possible to index each characteristic values as separated attribute, like this:
Characteristics.all.each do |characteristic|
    has	"IF(announces_characteristics.characteristic_id = #{characteristic.id}, announces_characteristics.v\
alue, null)", :as => "characteristic_#{characteristic.id}", :type => :integer
  end

This code doesn't work, but is it possible to do something like that?

In fact, adding
join announces_characteristics

make it work :).

Ah, great to know you found a solution!
Of course, this only works if characteristics aren't changing often (every time you have a new characteristic, you'll need to run ts:rebuild with the above approach).
Sphinx doesn't have any native concept of hashes/dictionaries, so while you can have both characteristic values and characteristic ids tied to an announce document in Sphinx, there's no way in Sphinx's standard attributes approach to link a specific characteristic value and id together.
One alternative is instead to have a Sphinx index on AnnounceCharacteristic, and group by announce_id - but this would only work when searching on single id/value pairs. Sphinx however, does also support JSON attributes, so perhaps an option is to store those values as a JSON hash in the attribute, and then construct a custom SphinxQL SELECT clause to filter on one or many key/value pairs. Something to consider for the future (or for others who come across this issue but are dealing with more dynamic key/value pairs).

In fact my solution work only for the first announces_characteristic.
Do you have a simple example of JSON attribute?
I didn't find examples on documentation.

You'd need to cache your id/value pairs as a JSON column on your Announce model, and then add that column as an attribute to your index.
has json_attribute

And then, once you've run rake ts:rebuild, the following should work (I've not tried it myself, but syntax is taken from this Sphinx blog post):
Announce.search :with => {"json_attribute.16" => 50}

Make sure you're using a 2.2.x release of Sphinx (from what I understand, this feature was introduced reliably in 2.2.1).

Thank you, it works very well.
This is what i did:
announce_index.rb:
has json_characteristics

announce.rb:
before_save :serialize_characteristics

def serialize_characteristics
    json = {}

    self.announces_characteristics.each do |ac|
      json[ac.characteristic_id] = ac.value
      self.json_characteristics = json.to_json
    end
  end

It works great :). Thank you.

Great! :)


DSLR live view still requested with webcam live view specified

Describe the bug
Webcam set up as secondary live view backend source. Photobooth still requesting live view from digicamcontrol. Additionally (but not the fault of photobooth-app) digicamcontrol is unable to supply an image via the method that photobooth-app is requesting it while live view is active.
Screenshots below show the digicamcontrol setup. The capture button in the first screenshot does not work when live view is active - only the button labeled "capture" in the live view pane does.
To Reproduce
Steps to reproduce the behavior:

Have DSLR tethered and webcam set up as secondary backend.
Take a photo
Photobooth will request live view from digicam
Attempt to take another photo after live view is activated
Timeout error

Expected behavior
Live view should not be requested if a different source for live video is selected. Maybe implement a specific way to choose which device you want live video from and only this device.
Additionally digicamcontrol appears to expect a different "capture image" request for when live view is active on DSLR.
Screenshots

Capture button that Photobooth is requesting.

Capture button that is expected by digicamcontrol while live view is active.
System (please complete the following information):

OS: Windows 10 Pro Build 19045
Browser Chrome
Version 129.0.6668.100 (Official Build) (64-bit) (cohort: M129 Rollout)
DigiCamControl Version <IP_ADDRESS>
Photobooth-app v4.0.0

Additional context
Log file attached below showing the error
photobooth_20241012.log
I'm very new to github so I'm sorry if I have any formatting wrong in this.
I've tried researching if the digicamcontrol issue is a bug but it seems that the software hasn't been updated since last year, and I can't seem to find a support forum that is active.

hi, yeah, the digicamcontrol backend might need improvement. does it work for you when the following line is commented out?
https://github.com/photobooth-app/photobooth-app/blob/5700e3e4cdca81cef6c0071db1739a7f6e98bcdb/photobooth/services/backends/digicamcontrol.py#L197

The behaviour is the same when this line is commented out.
If I close out the live view manually it works until a capture event is completed, then once it's done it reopens live view again.

You sure you edited the right place? Maybe in virtual env? Because there is only that on function calling the live window

I installed it globally and edited it in the programs folder
~\AppData\Local\Programs\Python\Python311\Lib\site-packages\photobooth\services\backends which was the only place I could locate digicamcontrol.py on my PC.
It's entirely possible I've edited the wrong file.

Sorry to ask, did you restart the app after the change? Could you please send another logging after the change?

No worries! I made the change while the app was offline. Also when I close down the app using CTRL-C the live view switches off. Hopefully this is reflected in the logs too.
photobooth_20241013.log

Hey, could you try applying this change and see if it fixes it for you?
https://github.com/photobooth-app/photobooth-app/commit/a3e5cb50c1e911e51a83e5f4210606151eaa734b

The other error about OSError: tjDecompressHeader3(): Could not determine subsampling level of JPEG image is probably because there is no proper image delivered from digicamcontrol because the liveview interferes, right?

The other error is because digicamcontrol defaults to RAW which is my fault. Nothing wrong with photobooth there, it's just expecting a JPEG.

photobooth_20241013.log
Still the same issue happening. the moment I run the photobooth app live view activates in digicamcontrol.
I let the program make all its attempts to get a photo while live view is active this time. And then did another attempt where I closed live view and got a successful capture.

Sorry, I forgot the return. File should look like this:
https://github.com/photobooth-app/photobooth-app/blob/2b291e35b2dcd7e913dda2a9ec5e32f0a7f4c0ca/photobooth/services/backends/digicamcontrol.py#L177-L179

photobooth_20241013.log
The webcam live feed doesn't activate and it throws an error when I try to take a capture.

sorry, there was an update to the update already, according to the logs you miss the return https://github.com/photobooth-app/photobooth-app/blob/2b291e35b2dcd7e913dda2a9ec5e32f0a7f4c0ca/photobooth/services/backends/digicamcontrol.py#L179

Hey, works with the return included? :)

Hi, I had added the return on line 179 before I tested it.

But line 180 is executed which means that the return was not hit.

photobooth_20241015.log

I forgot to change digicamcontrol from RAW to JPG again but this time it didn't change anything, so I'm wondering if the new error I have is happening before the image is sent. The countdown happens and then I get a little red toast notification saying it didn't work. Sorry if I've done anything wrong

Yeah, python uses indentation for conditionals. Indent by tab or space, mixing is not allowed.
TabError: inconsistent use of tabs and spaces in indentation
tells you about this and the error is at the return line. You need to check the whitespaces to be same. Should be spaces…

I'll redownload the whole file from here after I get home from work this evening.

photobooth_20241016.log
Yep, all working as intended now!

Great! So the change is included in the next release, closing this. If you have other issues feel free to open another ticket!

The next release was published recently: https://github.com/photobooth-app/photobooth-app/releases/tag/v4.1.0


Update record

Hi,
is there any way to update an already stored record?
Thanks

Well, you need to know to use CoreData a little bit.
You should first find record which you want to update then do it.
You can also use batch updates directly on persistent store.


Mater/Detail - how to save only selected row

Hello,
I created a master-detail relation in my table where I push the Items in the second grid on the selection of Characteristics Id
As you can see there are radio buttons on the second grid
So now, I want to save only one row (RED) in the transaction table on main save button

Thanks in advance!

Maybe intercept saving in repo and just skip it if not checked?

@ga5tan Thnks!


Refactor SdsApi to support dynamic certificate validation context.

Created a PR https://github.com/envoyproxy/envoy/pull/4355, close this one.


Chrome's search engine prompt causes testcafe process to fail

What is your Scenario?
See this article explaining the prompt https://www.ghacks.net/2023/12/09/google-chrome-to-display-choose-your-search-engine-prompt/
Error: Unable to open the "chrome:" browser due to the following error:

Error: WebSocket connection closed
    at /Users/me/projects/org-accountsettings-client/node_modules/chrome-remote-interface/lib/chrome.js:94:35
    at Chrome._handleConnectionClose (/Users/me/projects/org-accountsettings-client/node_modules/chrome-remote-interface/lib/chrome.js:256:13)
    at WebSocket.<anonymous> (/Users/me/projects/org-accountsettings-client/node_modules/chrome-remote-interface/lib/chrome.js:243:22)
    at WebSocket.emit (node:events:517:28)
    at WebSocket.emit (node:domain:489:12)
    at WebSocket.emitClose (/Users/me/projects/org-accountsettings-client/node_modules/chrome-remote-interface/node_modules/ws/lib/websocket.js:246:10)
    at Socket.socketOnClose (/Users/me/projects/org-accountsettings-client/node_modules/chrome-remote-interface/node_modules/ws/lib/websocket.js:1148:15)
    at Socket.emit (node:events:517:28)
    at Socket.emit (node:domain:489:12)
    at TCP.<anonymous> (node:net:350:12)
    at TCP.callbackTrampoline (node:internal/async_hooks:130:17)
    at BrowserConnection._runBrowse

What is the Current behavior?
When I run testcafe I see chrome opens briefly with that prompt and then testcafe fails and kills the browser before I can select anything there to make that prompt to go away.
What is the Expected behavior?
Let the browser to hang a little or suggest some chrome flag that can forbid this prompt if there is any.
What is the public URL of the test page? (attach your complete example)
yeah right
What is your TestCafe test code?
doesn't matter here
Your complete configuration file
"browsers": ["chrome --window-size=1280,800  --no-sandbox --disable-dev-shm-usage"],
disableNativeAutomation": false
The last one is important as it happens only in that case. When it is disabled, I have time to select the search engine in prompt and test continues. But when I run tests the next time I see the prompt again, so my selection is not saved for some reason.
Your complete test report
No response
Screenshots
No response
Steps to Reproduce
I don't know the exact steps to cause chrome to show this dummy modal window.
TestCafe version
3.6.2
Node.js version
v18.18.0
Command-line arguments
irrelevant, I use createTestCafe and didn't change any args
Browser name(s) and version(s)
Version 127.0.6533.73 (Official Build) (arm64)
Platform(s) and version(s)
macOS 14.5 (23F79)
Other
My settings in chrome are not saved, even if I manually open chrome/flags and turn off that search engine dialog, on the next run I see it again.

Hello @maksnester,
Thank you for your report.
Please refer to the #8240 issue. I'll close this issue as a duplicate.


Support for prefixes on struct fields?

First - thank you for writing and making this library available. It is very useful and works well integrating it into a few projects so far.
I'm wondering if you might consider a feature to enable for re-use of struct configuration. It might be easiest to explain with an example.
Today, to have an application configuration with two HTTP servers (app and admin), you might define it as follows:
type MyAppConfig struct {
	Http  *HttpConfiguration
	Admin *AdminConfiguration
}

type HttpConfiguration struct {
	Addr              string        `env:"APP_HTTP_ADDR,default=:8080"`
	ReadTimeout       time.Duration `env:"APP_HTTP_READ_TIMEOUT"`
	ReadHeaderTimeout time.Duration `env:"APP_HTTP_READ_HEADER_TIMEOUT"`
	WriteTimeout      time.Duration `env:"APP_HTTP_WRITE_TIMEOUT"`
	IdleTimeout       time.Duration `env:"APP_HTTP_IDLE_TIMEOUT"`
	MaxHeadersBytes   int           `env:"APP_HTTP_MAX_HEADERS_BYTES"`
}

type AdminConfiguration struct {
	Addr              string        `env:"ADMIN_HTTP_ADDR,default=:8081"`
	ReadTimeout       time.Duration `env:"ADMIN_HTTP_READ_TIMEOUT"`
	ReadHeaderTimeout time.Duration `env:"ADMIN_HTTP_READ_HEADER_TIMEOUT"`
	WriteTimeout      time.Duration `env:"ADMIN_HTTP_WRITE_TIMEOUT"`
	IdleTimeout       time.Duration `env:"ADMIN_HTTP_IDLE_TIMEOUT"`
	MaxHeadersBytes   int           `env:"ADMIN_HTTP_MAX_HEADERS_BYTES"`
}

With a struct tag like env:prefix, you might be able to simplify this to:
type MyAppConfig struct {
	Http  *HttpServerConfiguration `env:"prefix=APP_"`
	Admin *HttpServerConfiguration `env:"prefix=ADMIN_"`
}

type HttpServerConfiguration struct {
	Addr              string        `env:"HTTP_ADDR,required`
	ReadTimeout       time.Duration `env:"HTTP_READ_TIMEOUT"`
	ReadHeaderTimeout time.Duration `env:"HTTP_READ_HEADER_TIMEOUT"`
	WriteTimeout      time.Duration `env:"HTTP_WRITE_TIMEOUT"`
	IdleTimeout       time.Duration `env:"HTTP_IDLE_TIMEOUT"`
	MaxHeadersBytes   int           `env:"HTTP_MAX_HEADERS_BYTES"`
}

Existing extension mechanisms don't seem to support this. The PrefixLookuper supports prefixes at the top-level. The Decoder extension isn't given the context available to support parsing a struct (it supports single values). A struct tag is just an example of how this functionality might be supported - welcome to discuss possible implementations.

The implementation is slightly (one character) different from what you've described:
type MyAppConfig struct {
-	Http  *HttpServerConfiguration `env:"prefix=APP_"`
-	Admin *HttpServerConfiguration `env:"prefix=ADMIN_"`
+	Http  *HttpServerConfiguration `env:",prefix=APP_"`
+	Admin *HttpServerConfiguration `env:",prefix=ADMIN_"`
}

This is great @sethvargo - thanks!


EMQX won't start

s6-rc: info: service s6rc-oneshot-runner: starting
s6-rc: info: service s6rc-oneshot-runner successfully started
s6-rc: info: service base-addon-banner: starting

Add-on: EMQX
The most scalable open-source MQTT broker for IoT. An alternative for the Mosquitto add-on
Add-on version: 0.3.2
You are running the latest version of this add-on.
System: null  (aarch64 / qemuarm-64)
Home Assistant Core: 2024.1.3
Home Assistant Supervisor: 2024.01.0.dev0201
Please, share the above information when looking for help
or support in, e.g., GitHub, forums or the Discord chat.
s6-rc: info: service base-addon-banner successfully started
s6-rc: info: service fix-attrs: starting
s6-rc: info: service base-addon-timezone: starting
s6-rc: info: service base-addon-log-level: starting
s6-rc: info: service fix-attrs successfully started
[11:19:25] INFO: Configuring timezone (Asia/Shanghai)...
s6-rc: info: service base-addon-log-level successfully started
s6-rc: info: service base-addon-timezone successfully started
s6-rc: info: service legacy-cont-init: starting
s6-rc: info: service legacy-cont-init successfully started
s6-rc: info: service init-emqx: starting
s6-rc: info: service init-emqx successfully started
s6-rc: info: service emqx: starting
s6-rc: info: service emqx successfully started
s6-rc: info: service legacy-services: starting
[11:19:26] INFO: Starting EMQX...
s6-rc: info: service legacy-services successfully started
escript: exception throw: {emqx_conf_schema,[#{kind => validation_error,
path => "node.cookie",
reason => required_field}]}
in function  hocon_tconf:assert/2 (hocon_tconf.erl, line 1226)
in call from hocon_tconf:map/4 (hocon_tconf.erl, line 303)
in call from hocon_cli:get_values/3 (hocon_cli.erl, line 194)
in call from hocon_cli:multi_get/2 (hocon_cli.erl, line 182)
in call from escript:run/2 (escript.erl, line 750)
in call from escript:start/1 (escript.erl, line 277)
in call from init:start_em/1
in call from init:do_boot/3
ERROR: call_hocon_failed: -s emqx_conf_schema -c /opt/emqx/etc/emqx.conf multi_get node.data_dir node.name node.cookie node.db_backend cluster.proto_dist node.dist_net_ticktime(B
[11:19:29] INFO: Service EMQX exited with code 127 (by signal 0)
s6-rc: info: service legacy-services: stopping
s6-rc: info: service legacy-services successfully stopped
s6-rc: info: service emqx: stopping
s6-rc: info: service emqx successfully stopped
s6-rc: info: service init-emqx: stopping
s6-rc: info: service init-emqx successfully stopped
s6-rc: info: service legacy-cont-init: stopping
s6-rc: info: service legacy-cont-init successfully stopped
s6-rc: info: service fix-attrs: stopping
s6-rc: info: service base-addon-timezone: stopping
s6-rc: info: service base-addon-log-level: stopping
s6-rc: info: service base-addon-timezone successfully stopped
s6-rc: info: service fix-attrs successfully stopped
s6-rc: info: service base-addon-log-level successfully stopped
s6-rc: info: service base-addon-banner: stopping
s6-rc: info: service base-addon-banner successfully stopped
s6-rc: info: service s6rc-oneshot-runner: stopping
s6-rc: info: service s6rc-oneshot-runner successfully stopped

I have the same issue . The last working version for me is  0.2.14.


[v2] Colon in title or sidebar_label breaks markdown

🐛 Bug Report
Adding a colon (:) to title and/or sidebar_label content in a markdown document causes an error in v2 - works fine on v1.
Have you read the Contributing Guidelines on issues?
Yes
To Reproduce
(Write your steps here:)

Add a new markdown doc
Enter the following

---
id: ev_basics_lesson
title: EthVigil Primer: Deploying and Interacting with smart contracts
sidebar_label: Lesson EV001: Deploying and Interacting with smart contracts
---

Expected behavior
Should render the page normally
Actual Behavior
UnhandledPromiseRejectionWarning: YAMLException: incomplete explicit mapping pair; a key node is missed; or followed by a non-tabulated empty line
Reproducible Demo
https://github.com/SwaroopH/docusaurusv2-testing/tree/broken-title
Bug due to: https://github.com/SwaroopH/docusaurusv2-testing/blob/broken-title/docs/doc1.md

We use https://github.com/jonschlinkert/gray-matter now instead of our own extractheader function and this is more compliance with YAML spec.
You should use single quote string instead. Eg Lesson EV001: Deploying and Interacting with smart contracts

@endiliey Thank you! I tried escaping : but forgot to test the whole title as a string 🤦♂


Add struct column support to cudf_helpers

Description

Update make_table_from_table_info_data in cudf_helpers to build a table_metadata object used to add support for struct columns.
Update DatasetManager.df_equal to support list columns. Now uses pandas equals if val_to_check is a DataFrame of Series.
Add new jsonlines file to use for building test DataFrame that includes struct and list columns.
Update MessageMeta and ControlMessage tests to use new test data.

Closes #1527
By Submitting this PR I confirm:

I am familiar with the Contributing Guidelines.
When the PR is ready for review, new or existing tests cover these changes.
When the PR is ready for review, the documentation is up to date with these changes.

/ok to test

/ok to test

/merge


MWPW-118659 Add JP Font

Add JP font
Enable JP locale

Resolves: MWPW-118659
Test URLs:

Before: https://main--bacom--adobecom.hlx.page/jp/customer-success-stories/geniee-case-study?martech=off
After: https://jp-font--bacom--adobecom.hlx.page/jp/customer-success-stories/geniee-case-study?martech=off

Codecov Report

Merging #31 (a440e75) into main (ef19c52) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##              main       #31   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            1         1
  Lines           42        42
=========================================
  Hits            42        42

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

FWIW: with CJK, your site perf will tank. This is due to typekit doing dynamic subsetting which is incredibly costly. The alternative is downloading every CJK glyph which is also not ideal.

This has been verified. @meganthecoder


Add Organization

The repository is missing a few things that would match it well with other DataONE repositories.

[ ] The Readme needs to have an about section and DataONE/KWG/NSF logos.
[ ] The repository needs community guidelines

Competed in 05f6fcb32470d0ecbb433ab208ccb271da1f1d61


chore: remove travis and circle and add jenkins

@VictorBjelkholm Does the Jenkinsfile need to be in master before it'll pass?  Seeing some weird errors for this PR in Jenkins: https://ci.ipfs.team/blue/organizations/jenkins/IPFS Shipyard%2Fipfs-blob-store/detail/update-ci/2/pipeline/17


Unable to run in simulator on M1 Macs

I am unable to build and run my projects which use Bond since I have switched to a new M1 Mac. I get the following error:
Could not find module 'Bond' for target 'x86_64-apple-ios-simulator'; found: arm64, arm64-apple-ios-simulator

I have google'd this error and none of the workarounds seem to help. Is this something one of you have run into? I am only getting this error in my one project that uses ReactiveKit and Bond.

Are you using Swift Package Manager?

I'll be getting M1 in a week or two, so I'll be able to test this only then.

I'll be getting M1 in a week or two, so I'll be able to test this only then.

Any update on this? I can see a new update on ReactiveKit. Will you update Bond as well?

Any Update on this one? Still having the same issue

Any updates on this? Should we switch to ReactiveKit?


How to build arrow from source with ORC?

I'm trying to build arrow from source with ORC on Ubuntu 18.04.
Actually my ubuntu is a docker container and my dockerfile is as folows:
The build was successful, but I get an error when I import pyarrow._orc.
Is there something wrong with my build?

Could you please report a Jira issue or write to<EMAIL_ADDRESS>if you need help?


sibnet error 403

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2021.04.26
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 1967, in process_info
    success = dl(filename, info_dict)
  File "/usr/local/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 1906, in dl
    return fd.download(name, info)
  File "/usr/local/lib/python3.9/site-packages/youtube_dl/downloader/common.py", line 366, in download
    return self.real_download(filename, info_dict)
  File "/usr/local/lib/python3.9/site-packages/youtube_dl/downloader/http.py", line 351, in real_download
    establish_connection()
  File "/usr/local/lib/python3.9/site-packages/youtube_dl/downloader/http.py", line 116, in establish_connection
    raise err
  File "/usr/local/lib/python3.9/site-packages/youtube_dl/downloader/http.py", line 110, in establish_connection
    ctx.data = self.ydl.urlopen(request)
  File "/usr/local/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 2279, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/local/lib/python3.9/urllib/request.py", line 523, in open
    response = meth(req, response)
  File "/usr/local/lib/python3.9/urllib/request.py", line 632, in http_response
    response = self.parent.error(
  File "/usr/local/lib/python3.9/urllib/request.py", line 561, in error
    return self._call_chain(*args)
  File "/usr/local/lib/python3.9/urllib/request.py", line 494, in _call_chain
    result = func(*args)
  File "/usr/local/lib/python3.9/urllib/request.py", line 641, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

Description

When I try to download from sibnet with such a link,
https://video.sibnet.ru/video2643599-_AnimeOu_Kaichou_Wa_Maid_Sama__04/?utm_source=player&utm_medium=video&utm_campaign=EMBED
I get the error 403.

Maid Sama! is a copyrighted material. Anime companies (and others) won't like youtube-dl supporting downloading copyrighted materials.


Dockerfile fails to build ("Test: case_expr_extend -> ERROR!")

Steps to reproduce the issue

Clone this repo
Try to build the docker image

Expected behavior

Docker image builds successfully

Actual behavior
[100%] Building share/sf2/arith_map.v
[100%] Building share/sf2/cells_map.v
[100%] Building share/sf2/cells_sim.v

  Build successful.

mkdir -p /opt/yosys/bin
cp yosys yosys-config yosys-abc yosys-filterlib yosys-smtbmc /opt/yosys/bin
strip -S /opt/yosys/bin/yosys
strip /opt/yosys/bin/yosys-abc
strip /opt/yosys/bin/yosys-filterlib
mkdir -p /opt/yosys/share/yosys
cp -r share/. /opt/yosys/share/yosys/.
cd tests/simple && bash run-test.sh ""
make[1]: Entering directory '/yosys/tests/simple'
+ gcc -Wall -o /yosys/tests/tools/cmp_tbdata /yosys/tests/tools/cmp_tbdata.c
Test: arrays02 -> ok
Test: asgn_binop -> ok
Test: case_expr_extend -> ERROR!
Note: Make sure that 'iverilog' is an up-to-date git checkout of Icarus Verilog.
make[1]: *** [../tools/autotest.mk:10: case_expr_extend.sv] Error 1
make[1]: Leaving directory '/yosys/tests/simple'
make: *** [Makefile:786: test] Error 2
The command '/bin/sh -c cd /yosys  && make  && make install  && make test' returned a non-zero code: 2
ERROR: Service 'yosys' failed to build : Build failed

If I remove make test, yosys exits with:
Yosys 0.12+45 (git sha1 UNKNOWN, clang 7.0.1-8+deb10u2 -fPIC -Os)

ERROR: Assert `pass_register.count(pass_name) == 0' failed in kernel/register.cc:629.

I believe I have a decent idea what's going wrong here. I'll provide a fix tomorrow.


make validate_{} functions return {slot: value} dicts instead of just values

Proposed changes:

validate_{} functions now return {slot: value} dicts instead of just value, so that they can update other slots as well
adds example of validate_{} function

To add

[ ] iterate over a copy instead of the real slot_values dict since the size changes

Status (please check what you already did):

[x] made PR ready for code review
[ ] added some tests for the functionality
[ ] updated the documentation
[x] updated the changelog
[ ] update README compatibility chart

UPDATE RASA CORE

these changes must also be reflected in core in the main repo

could you please add debug statement that all required slots are filled (maybe with printing values, similarly how we print slot values in core) before calling submit method

@Ghostvv yes i can add that, will add to #67 instead since that will be in the next minor and this one's breaking

sure, sorry I put in wrong place then, too many similar PRs 🙈


BUG: adds warning to scipy.stats.brunnermunzel

Reference issue
closes #15843
What does this implement/fix?
emits a warning when scipy.stats.brunnermunzel cannot compute p-value
because both numerator and denominator are 0, and therefore p-value is nan
also suggests an alternative (using distribution="normal")
This change does not change any output/no code is changed. The only change
is emitting a warning in some cases where output p-value is nan
also add two tests:

test_brunnermunzel_return_nan tests that the correct warning is raised when using a t-distribution
test_brunnermunzel_normal_dist tests that p=0 when using a normal dist with the problematic dataset

Thanks. If the suggestions above look OK to you, I'll push them, but there's one more thing needed before merge. Can you add your example as a test in scipy/stats/tests/test_stats.py class TestBrunnerMunzel. Please add a comment about the purpose of this test, mention the original issue (gh-15843), and use with pytest.warns(RuntimeWarning, match='p-value cannot be estimated') to check that the warning is emitted as intended?

@mdhaber  will do, thanks for the review and changes!

@mdhaber thanks for the suggestions. added your changes, and also added two tests which check for warning and correct p when using a normal distribution. i verified that those two tests pass locally.

Thanks! I'd suggest finding an option in your IDE that removes trailing spaces when it saves. Helps avoid PEP8 issues.
I fixed those and added "(see gh-15843)" to the test descriptions. Fingers crossed that CI comes back green! If so, I'll merge.

thank you! fyi i had to disable my autoformatter (black) because it changed everything else in the file.
also the imports are in a non pep8 order in some of the modules so i had to disable isort too

thank you! fyi i had to disable my autoformatter

Thank you for doing that!

Thanks for the bug report and fix @sg-s!  The Main Windows Python310 seems to have hung, as it frequently does, so I'll merge now.
Just curious - what are you using brunnermunzel for, and how did you run across the issue?

@mdhaber i have a dataset with relatively small n (3-10) where in some cases there was clearly a difference by eye, and t-tests were saying it wasn't different. turns out my data isn't normal, and also is heteroskedastic and what i should have done is a permutation test (which is what i used eventually). but brunnermunzel was one of the things i tried because it seemed to have lower restrictions.

Great! Did you use permutation_test to do the permutation test? Thanks!

yup, ended up using permutation_test


llvmPackages.llvm-manpages: fix eval on Darwin

Darwin prevents curl from being used in the Darwin bootstrap. The man pages are built for darwin.binutils-unwrapped, but overrides are applied only there, leaving plain llvmPackages.llvm-manpages broken.
The fix is to move the override to the llvmPackages package set.
This is targeting master because it shouldn’t cause any rebuilds.

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Formatter is unhappy, and we really need to get this out of the bootstrap, but LGTM otherwise. Won’t merge before ofborg confirms the lack of rebuilds.

Formatter is unhappy

Should be fixed in the push.

we really need to get this out of the bootstrap

llvm-manpages is an override of llvm, which builds with the dependencies available to it in stage 3 — meaning no curl. It might be possible to overlay super.llvm-manpages for llvm-manpages, but I didn’t try that.


Says "Python not installed", even if it already is.

for some reason it ask me to download python even though its installed?

In cmd type python --version
If it says not found, then install python (even if you already have).
Make sure to tick the Add Python To Path option in the python installer.

ty!

?

https://github.com/Blank-c/Blank-Grabber/issues/152


[Feature]前端访问支持vue通过NGINX部署在子目录或者二级目录

当前访问：http://<IP_ADDRESS>/
支持二级目录 dolphinscheduler 后访问: http://<IP_ADDRESS>/dolphinscheduler/

+1

Now , Dolphinscheduler-1.2.1 has support for secondary directory access to the vue.
Thanks a lot.

Close the issue since it has been resolved


Hurdle Race- HackerRank

Ques
A video player plays a game in which the character competes in a hurdle race. Hurdles are of varying heights, and the characters have a maximum height they can jump. There is a magic potion they can take that will increase their maximum jump height by 1 unit for each dose. How many doses of the potion must the character take to be able to jump all of the hurdles. If the character can already clear all of the hurdles, return 0.
Details:

Programming Language

[x] C++

@ravikr126 @sameeksharl please assign this issue to me under the label LGMSOC

@ravikr126 @sameeksharl please assign this issue to me under the label LGMSOC


Route to Classifier

Do not be intimidated by the number of lines added! They are mainly boilerplate tests.
Link to InVision prototypes
This PR does several things:

Routes from the landing page to the classifier. Click "log in" to proceed to the projects page. Login isn't hooked up yet, so no need to complete the form. I'd like some feedback on the routing. I was thinking of doing the projects/:id/workflows/:id/subject-sets/:id, etc. type routing, but I'm not sure if this is necessary.

Restyle some items after viewing components on their respective page.

Add render tests to many components. I did this as one of the final commits to bring the code coverage up, but it mainly consists of checks that the rendered component doesn't crash.

Cool! I fixed the Slavey typo and linked to "edit" instead of "editor," although those paths may change in the future. No luck on the major one. I'm just all out of options on how else to spell it.
I'll keep the note on folder organization in mind going forward. I suppose using sub-directories is only necessary when many extra files or components are present.


Problems when running LogicApp: SecurityCopilot-SOCshift-reporting-transfer

There seems to be an error with the Incident split

new update has been published https://github.com/Azure/Copilot-For-Security/tree/main/Logic Apps/SecurityCopilot-SOCshift-reporting-transfer


Cool (but not quality) redraw glitches when resizing

See

More pronounced in Windows Terminal (above) than in cmd.exe, mostly because cmd.exe paints much faster.

But at least now the image is not distorted when we have finished scaling it. Although it is boring, despite that.

I think this is a problem with the Windows terminal - where the "reflow smarts" trigger before the application has received a notification that the window size changed.   So the reflow kicks-in, reorders the content, then the message is sent to the application "Hey your size changed" which triggers the repaint.
This is exactly the same problem that XtermSharp and SwiftTerm surface.

@migueldeicaza That is why I insist that if it is not the gui.cs itself that deals with repainting then the problem would be enormous, if it is personalized by each application that integrates it in its projects.

I am not sure I understand the suggestion @BDisp

It's nothing. Never mind.


Solar eclipse animation

I have created  solar eclipse animation using html and css
Video of animation
https://github.com/Durgesh4993/web_Animation/assets/92216225/2900de89-a35d-486b-82ca-7aae5ef082c4

connect with me -
Github : https://github.com/Durgesh4993
LinkedIn : https://www.linkedin.com/in/durgesh4993/
And don't forget to star

Hi @Durgesh4993 I have already forked repo and completed my work please merge the pull request


Universal SSR render error - Cannot read property 'hooks' of undefined

I'm submitting a ...  (check one with "x")
[x ] bug report => search github for a similar issue or PR before submitting
[ ] feature request
[ ] support request

Current behavior
Visiting a page with a formly form rendered by Angular Universal SSR, I get an error, the page doesn't load at all. The same page renders fine if rendered by browser.
TypeError: Cannot read property 'hooks' of undefined
    at FormlyField.triggerHook (/home/test.universaledition.com/web/dist/server.js:171488:24)
    at FormlyField.ngOnDestroy (/home/test.universaledition.com/web/dist/server.js:171432:14)
    at callProviderLifecycles (/home/test.universaledition.com/web/dist/server.js:77721:18)
    at callElementProvidersLifecycles (/home/test.universaledition.com/web/dist/server.js:77689:13)
    at callLifecycleHooksChildrenFirst (/home/test.universaledition.com/web/dist/server.js:77679:29)
    at destroyView (/home/test.universaledition.com/web/dist/server.js:85875:5)
    at callViewAction (/home/test.universaledition.com/web/dist/server.js:86001:13)
    at execEmbeddedViewsAction (/home/test.universaledition.com/web/dist/server.js:85944:17)
    at destroyView (/home/test.universaledition.com/web/dist/server.js:85873:5)
    at callViewAction (/home/test.universaledition.com/web/dist/server.js:86001:13)

Expected behavior
Page should render with the form without any complications, no matter if it's SSR or browser rendered.
Please tell us about your environment:
using @nguniversal/express-engine for SSR
(Node Express server)
Latest version of ngx-formly (5.5.1)
All libraries updated via npm update.

Angular version: 8.2.11

Browser: [all]

Language: [all]

I checked this issue even though I don't have any custom fields, but part of the error is the same: https://github.com/ngx-formly/ngx-formly/issues/1821 Moreover, the issue says it should be resolved by 5.5.0, which for me it isn't. Any help would be appreciated. The form is really quite basic.

which UI do you use?

which UI do you use?

Bootstrap

somehow the field is undefined during onDestroy call, I'm going to fix that, but I would like it if possible to provide me a reproduction example in order to avoid a regression in the future.

Thanks. I wonder how to approach this. Would it be possible to show you my workflow say via a quick call and screen sharing first?

somehow the field is undefined during onDestroy call, I'm going to fix that, but I would like it if possible to provide me a reproduction example in order to avoid a regression in the future.

Hi so I went ahead and created a repository for you (invited via Github) with a very bare app that showcases what's happening.
Please run the following to build & run:
npm install
npm run build:ssr
npm run serve:ssr

After that you will see the error.
Obviously you can run ng serve to see what the behavior should be.
Thank you for your help!

ok thinks!

@aitboudad Thanks for the fix! Is there a way for me to test this change in our environment?

use the following workarround until the new version is released.
const win = createWindow(template);
global['window'] = win.window;
global['document'] = win.document;
global['navigator'] = win.navigator;
global['localStorage'] = win.localStorage;
+ // TODO: remove after updating to formly `5.5.2`
+ global['FileList'] = Object;
+ global['File']= Object;
+ global['Blob'] = Object;

Thanks, unfortunately this won't work in my case as we're building using Jenkins so I don't think I have control over changing anything in node_modules.

the above changes are located in your server.ts file which part of your source code and not node_modules

Ohh, my bad - thanks!

v5.5.2 is released which includes a fix for this issue.

I have the same issue with Angular universal (SSR) using material UI.
formly version: 5.5.11

@eng-dibo our E2E test seems working (material ui is covered), so in that case we may need a reproduction example.

@aitboudad
even after this issue occuers, once I restart the server it works.

this is the details of the error
TypeError: Cannot read property 'hooks' of undefined
    at FormlyField.triggerHook (dist\server\main.js:187943:24)
    at FormlyField.ngOnDestroy (dist\server\main.js:187891:14)
    at callProviderLifecycles (dist\server\main.js:92849:18)
    at callElementProvidersLifecycles (dist\server\main.js:92808:13)
    at callLifecycleHooksChildrenFirst (dist\server\main.js:92790:29)
    at destroyView (dist\server\main.js:103890:5)
    at callViewAction (dist\server\main.js:104049:13)
    at execEmbeddedViewsAction (dist\server\main.js:103986:17)
    at destroyView (dist\server\main.js:103888:5)
    at callViewAction (dist\server\main.js:104049:13)
    at execComponentViewsAction (dist\server\main.js:103957:13)
    at destroyView (dist\server\main.js:103889:5)
    at callViewAction (dist\server\main.js:104049:13)
    at execEmbeddedViewsAction (dist\server\main.js:103986:17)
    at destroyView (dist\server\main.js:103888:5)
    at callViewAction (dist\server\main.js:104049:13)

@eng-dibo fixed in v5.6.0 release.

great version, I'm so excited to try it.

I have same issue and I don't know why its happen .  my package is
"dev:server": "nodemon --watch build --exec node dist/bundle.js  ",
"dev:build:server": "webpack --config webpack.config.js --watch --env.mode=prod",
"dev:build:client": "webpack --config webpack.config.js --watch --env.mode=dev",
there isn't bug in compile client and server ,both of them compile correctly
its a  small section of my server.ts
const app = express();

app.use(require('webpack-dev-middleware')());

//add the bundle file to the project
app.use(express.static(path.resolve(__dirname, '../../lib')));
//add static files in project
app.use(express.static(path.resolve('../../asssets')))

app.get("*", (req, res) => {
	const store = createStore(req);
	const promises = matchRoutes(Routes, req.path)
		.map(({ route }) => {
			return route.loadData ? route.loadData(store) : Promise.resolve(null);
		})
		.map((promise) => {
			if (promise) {
				return new Promise((resolve, reject) => {
					promise.then(resolve).catch(resolve);
				});
			}
		});

and its error

TypeError: Cannot read property 'hooks' of undefined
    at e.exports (C:\Users\USER\react-app\dist\bundle.js:358:69797)
    at e.exports (C:\Users\USER\react-app\dist\bundle.js:358:34433)
    at Object.<anonymous> (C:\Users\USER\react-app\dist\bundle.js:158:79264)
    at Object.<anonymous> (C:\Users\USER\react-app\dist\bundle.js:158:80189)
    at t (C:\Users\USER\react-app\dist\bundle.js:1:101)
    at Object.<anonymous> (C:\Users\USER\react-app\dist\bundle.js:158:78884)
    at t (C:\Users\USER\react-app\dist\bundle.js:1:101)
    at C:\Users\USER\react-app\dist\bundle.js:1:1144
    at Object.<anonymous> (C:\Users\USER\react-app\dist\bundle.js:1:1155)
    at Module._compile (internal/modules/cjs/loader.js:1158:30)
[nodemon] app crashed - waiting for file changes before starting...

@tmohammad78 sorry, I've no idea on that part :pray:!

@aitboudad
thank you , No problem


fix FRI fold formula

Motivation

FRI fold formula has a typographical error.
Solution

Change $f(x)   = f_e(x) + x * f_o(x)$ to $f(x)   = f_e(x^{2}) + x * f_o(x^{2})$.

Nice catch! Thank you


Querying for split cards in active mode returns incorrect or no card image

Hi, I hope you're well.
My group and I have noticed that querying for either half of a split card currently doesn't work in active mode. The bot will either return nothing or return an incorrect card image. For instance, neither [[Commit]], [[Memory]], nor [[Commit // Memory]] will return Commit // Memory. The same goes for cards that have an Adventure; neither [[Stomp]] nor [[Bonecrusher Giant]] will return Bonecrusher Giant. Presumably this is an issue with a single card face having multiple names.
The expected behaviour is that querying for either half of the card would return an image of the entire card face, assuming that the query text is closer to one of the split card names than it is to any other card name. Similarly, querying [[Commit memory]] or [[Commit // Memory]] would return the entire card.
Thank you as always for your wonderful bot!

Hi! Thanks for the kind words and for reporting this issue.
I've confirmed the issue you're reporting, well found!
It seems that this issue arises because split cards have a card_faces property, which we normally use only for double-faced cards. So the bot tries to find an image for the "split" you request in card_faces, but it doesn't exist because the card only has a single face.
I'll try to fix it this weekend!

I have a fix ready, which can be tested on the beta bot (ScryfallBetaBot)!

If all goes well, I'll merge this into to the main bot tomorrow.


add pytorch180

remove bg_iterator from data test
test 1.8.0
remove in-place for 1.8 jit
remove soundfile backend deprecation

@vincentqb @mthrok
when updating the code base to torch 1.8.0/torchaudio 0.8.0 i noticed some failing tests:
https://github.com/sigsep/open-unmix-pytorch/blob/a0ab7c2382fd5004b0af3d49d0caec4d8a7f238a/tests/test_regression.py#L76-L94
these regression tests are failing on macOS locally, are you aware of any changes with respect to torch.fft/torch.stft on macOS that could have caused those?

Hi @faroit
I am not aware of such regression. I think we should open an issue on PyTorch.

@mthrok I was starting with a clean environment and things also pass locally. So probably just caused by some caching issue. thanks for your time ;-)


Add feature to move cursor programmically

I'm currently stuck without a function like move_mouse_cursor_to(point: Point) or  move_mouse_cursor_to(element: Element)
I'd really like to have one in this awesome project.
If it exists somewhere here and I missed it please write in comments how can I do this in current version.
Thanks for your time.

What is your use case for it? It's not a great way to do… anything, really. e.g. Wayland does not have a way to do this at all. If you want to be able to lock the pointer inside of an area (and possibly get relative motion like for a 3D camera), that's the abstraction that should be exposed by the GUI library (iced).

In my case I had a canvas and I wanted to have a button "center on canvas" which had to move cursor to well the center the canvas.


fix: add sideEffects flag for es package.json

Currently tree shaking doesn't work, because es/package.json doesn't have "sideEffects" flag in it
This PR fixes the problem
Before 👎:

After 👍:

Oh what a cool fix to finally solve the problems with the bundle

I'm curious why es/package.json needs it as we already have it in the top level package.json. Could you help me minimally reproduce this? What bundler are you using?

We are using webpack 5.x.x. For some reason it take into account the es/package.json file and adding "sideEffects": false to it changes webpack's behavior.
After deeper investigation I noticed that it doesn't actually all ramda function to the bundle. However tree-shaking works wrong when the app consists of multiple chunks, and each chunk imports different ramda functions. Without the sideEffects flag webpack creates single chunk with all imported ramda functions, and this chunk is imported in all other chunks. With sideEffects: false webpack works correctly (each chunk has ramda functions that are imported inside the chuink)
Here is a repo where you can reproduce the issue:
https://github.com/laboskin/ramda-tree-shaking-test
Build it once (npm run build), then add sideEffects: false to node_modules/ramda/es/package.json and build it again. You will see the difference in reports of WebpackBundleAnalyzer and in output .js files
I also committed 2 report files (report_default.html and report_with_sideEffects_false.html) for convinience.

Brilliant, thank you @laboskin .
I was able to reproduce locally. It looks to me like we also get the correct bundle if we remove es/package.json altogether, yes? But that probably doesn't matter for now as we still need {"type": "module"} somewhere.
Previous related PRs:
https://github.com/ramda/ramda/pull/2999
https://github.com/ramda/ramda/pull/3382
I will leave open for a bit to let others comment but this looks good to me.

@kedashoe I am not sure about removing es/package.json completely. I believe there was a purpose for adding it and if we remove it, it may cause problems for some esm or non-esm dependents. Adding sideEffects flag seems like a safer option

@kedashoe I am not sure about removing es/package.json completely. I believe there was a purpose for adding it and if we remove it, it may cause problems for some esm or non-esm dependents. Adding sideEffects flag seems like a safer option

Agreed


different FCOS3D AP11 results between table1 and table3 in PGD paper

13.90 11.61 10.98 and 9.55 5.51 4.78

which one is the FCOS3D implementation?
if the higher is, what the implementation difference of the lower one?

thank you for your reply !

@Tai-Wang

The version for ablation (Table 3) is a basic one of FCOS3D, almost without any modifications when transferring the nuScenes model to KITTI. After some hyperparameter tuning and adding some tricks (such as adding auxiliary 2D box/keypoint targets), it can be enhanced to some extent (results in Table 1). Similarly, you can find the performance of PGD is also improved accordingly in Table 1.

Thank you very much ! Another  problem， where can i download the supplemental materials mentioned in the pgd paper?

The version for ablation (Table 3) is a basic one of FCOS3D, almost without any modifications when transferring the nuScenes model to KITTI. After some hyperparameter tuning and adding some tricks (such as adding auxiliary 2D box/keypoint targets), it can be enhanced to some extent (results in Table 1). Similarly, you can find the performance of PGD is also improved accordingly in Table 1.

You can find it in the openreview page or in its arxiv version.

thank you~

You can find it in the openreview page or in its arxiv version.

thank you~


Github benchmark fails

build/benchmarks/bench: error while loading shared libraries: benchmarks/libservo_url.so: cannot open shared object file: No such file or directory

@lemire Can you take a look at this? I couldn't find the underlying problem here.

I can. Yes. Let me see.

Fixed.


Logical model examples without resourceType or id

This PR adds a note to the Tips and Tricks section about logical model examples without resource type and id. I wasn't exactly sure where this should fit because it is really similar to the existing documentation. Let me know what you think.
Note: this approach is based on discussion on Zulip here.
Do not merge this PR until there is a SUSHI release that includes support for this.

I've updated this PR to use the current extension URL for IG resource format, since the one we had documented has been deprecated.
I've also updated it use a full canonical URL in the resourceType of our example since that is correct (SUSHI will still allow ids there, but we should document best practice). It had been bugging me for a while that our example Logical Model does not have an id element but the example Instance of it does (technically making the example invalid for that logical model), so I added an id element as well.


feat: Add node's ssh key to Juju model on join

Uses juju add-ssh-key to add the node's public key to the model, allowing users to ssh to each machine with juju ssh

@wyattrees could you please sign the commits in order to merge this? Feel free to also squash into 1 with only you as a committer. :slightly_smiling_face:


Add base.duplicate_table method

Not sure if this is a feature we want, but seeing as it can be done in the web UI I figured it may be worth adding.
Adds test function emulating duplicating a table with and without copying records.
The schema is always duplicated.

I'm not sure this is something that belongs in the client library since it's not a supported endpoint. Airtable does provide a web UI for copying a base, but they don't expose that functionality through the API. The "copy base" feature on the web has certain features, like copying comments, which we wouldn't be able to replicate ourselves, and some library users might be misled into thinking that this method offers equivalent functionality.
We've had some of our own use cases for things like this, and we've found there are a lot of detailed decisions to make that are specific to our own use case. I suspect other library users who might want to duplicate bases programmatically will also need to work through a lot of details on their own.

Sounds good!


error installation windows:  fatal error C1083: CbcConfig.h

Hi,
i have been trying to install OR-tools for the last hours now and I am experiencing a bunch of errors.
After being able to resolve a few, this is where i now stand:

all the dependencies are installed - VS, git, cmake, and SVN;
i downloaded the OR-tools zip, as the git clone gave me a bunch of errors (unable to run tools\make third_party)
the tools\make third_party is giving me the following error:

.\ortools\linear_solver\cbc_interface.cc(35): fatal error C1083: Não é possível abrir arquivo incluir: 'CbcConfig.h': No such file or directory
tools\make: *** [objs/linear_solver/cbc_interface.obj] Error 2

Hi,
Which version did you download exactly  ?
Could you try the github master instead ?
Thanks


Error installing pybindings

When I try to install Quizx with its Python bindings, I get the following error:
error[E0308]: mismatched types
   --> src/lib.rs:231:36
    |
231 |     fn max_terms(&self) -> usize { self.d.max_terms() }
    |                            -----   ^^^^^^^^^^^^^^^^^^ expected `usize`, found `f64`
    |                            |
    |                            expected `usize` because of return type

Here is an exact description of what I tried, in a reproducible Dockerfile:
FROM rust:alpine3.16

#################
# PREREQUISITES #
#################

RUN apk update && \
    apk add \
        git \
        build-base \
        python3 \
        py3-pip

RUN pip3 install setuptools-rust

#################
# INSTALL QUIZX #
#################

RUN git clone https://github.com/Quantomatic/quizx.git /quizx

RUN cd /quizx/quizx && \
    cargo build && \
    cargo test

###########################
# INSTALL PYTHON BINDINGS #
###########################

RUN cd /quizx/pybindings && \
    python3 setup.py install

RUN cd /quizx/pybindings && \
    python3 setup2.py install

The error occurs for the last line.

@akissinger @tuomas56 Thoughts?

Any updates on this issue? If not, I will try to work with the rust code directly.

This should be fixed by #8 (you can clone my branch if you want to use it before then) - it was just a case of the Python bindings not being kept up to date with the Rust library. However, in general the Python bindings aren't as feature-complete as the rust code - I would recommend working with the Rust library directly, or using PyZX if you prefer Python and don't need the speed (or the stabilizer decompositions).

Thanks, I can confirm that your branch fixes the installation issue, at least.

It's now merged into main. Thanks Tuomas!


Bug: Automatic WebSocket Reconnection Between Frontend and Backend

Requesting the implementation of automatic reconnection for WebSocket connections between the frontend and backend. This feature would help maintain a stable connection and improve user experience by reducing manual reconnection needs during drops or interruptions.

This is more of a bug than a feature request. I tried in the past to do reconnecting when connection is lost but js is acting weird so for now I'll leave it as is.

I'll look into it, if I find the time. :)


react-native support?

Hi, thanks for the library, the demos look fantastic.
We plan on building cross-platform components and are looking at animating solutions. Would it be feasible for this project to support react-native? Do you have ideas for an approach? Would you be interested in PRs towards this?
Thanks

@stevoland rn would most certainly be possible, since animated supports it. I removed react-native.js from animated/targests but if put back it should be fine.
PRs are welcome.

anyone managed to make it work with RN ?

+2

What do you mean by “I removed react-native.js”

I think it would only be a matter of a few polyfills (request/cancelAnimationFrame) and adding View/Image/etc animated components under /arc/animated/targets/react-native. But i don't have the capacity right now and i haven't done much in RN. If anyone wants to give it a go - i could provide some guidance on project structure.

Anyway, i had some free time today - it's looking good so far. You can try it out:
import React from 'react'
import { StyleSheet, Text, View, TouchableWithoutFeedback } from 'react-native'
import { Spring, animated } from 'react-spring/dist/react-spring-native.esm'

const styles = {
    flex: 1,
    margin: 0,
    borderRadius: 35,
    backgroundColor: 'red',
    alignItems: 'center',
    justifyContent: 'center',
}

export default class App extends React.Component {
    state = { flag: true }
    toggle = () => this.setState(state => ({ flag: !state.flag }))
    render() {
        const { flag } = this.state
        return (
            <Spring native from={{ margin: 0 }} to={{ margin: flag ? 100 : 0 }}>
                {props => (
                    <TouchableWithoutFeedback onPressIn={this.toggle}>
                        <animated.View style={{ ...styles, ...props }}>
                            <Text>It's working!</Text>
                        </animated.View>
                    </TouchableWithoutFeedback>
                )}
            </Spring>
        )
    }
}

Never mind, colors work - must've been the emulator, on my iphone it's fine. So to me it looks like all behaves as it should be. I'll run some tests and it will be available under react-spring/dist/native in the next release.

@stevoland @Hamatek @MarcelBlockchain @smooJitter are there any things to watch out for now? For instance, in the dom we use animated.div animated.h1 and so on, it's basically just a list of strings, but in RN if i wanted to pull all the available primitives (View, Text, Image, ........) --- these are real classes, and it would pull down bundle-size. Would RN users be ok if i don't expose "animated" and instead you create your own primitives using createAnimatedElement like so:
import { Spring, createAnimatedComponent } from 'react-spring/dist/native'
import { View } from 'react-native'

const AnimatedView = createAnimatedElement(View)

<Spring ...>
    {props => <AnimatedView ... />}
</Spring>

?

Released it: 5.3.1: https://twitter.com/0xca0a/status/1000513216672403456
Goes actually further than react-native, it could animate all platforms now.

Whoa....  I will take a look in a few days.  I'm traveling for the holiday.

I will take a look in a few days.  I'm traveling right now.

Is react-spring now capable to be used with React Native? Did this go anywhere?
@a-m-dev @drcmda Have you heard anything?

any production level examples ?

Is there a repo or any examples with RN?

DevHub uses it on iOS, Android and web: https://github.com/devhubapp/devhub
Works great.

@brunolemos
Thank you. Is it just used from this repo out-the-box or is extra configuration required? Perhaps the repo you linked will show how it's done.


Tensorflow 2.5: Segmentation Fault

I am trying to run a large 3D U-net and my dataset size is 55GB. It doesn't finish more than 6 epochs and then I get a segmentation fault.
System information: TF 2.5 / CUDA 11.2 / cuDNN 8.1
GPU : 10GB
Server has 32GB of RAM.
The code for my data generator is as follows:
def open_data_file(filename, readwrite="r"):
    return tables.open_file(filename, readwrite)

data_file_opened = open_data_file(os.path.abspath("../data/data.h5"))

train_generator, validation_generator, n_train_steps, n_validation_steps = get_training_and_validation_generators(
        data_file_opened,
        ......)

where:
def get_training_and_validation_generators(data_file, batch_size, ...):
    training_generator = data_generator(data_file, training_list,....)

data_generator function is as follows:
def data_generator(data_file, index_list,....):
      orig_index_list = index_list
    while True:
        x_list = list()
        y_list = list()
        if patch_shape:
            index_list = create_patch_index_list(orig_index_list, data_file, patch_shape,
                                                 patch_overlap, patch_start_offset,pred_specific=pred_specific)
        else:
            index_list = copy.copy(orig_index_list)

        while len(index_list) > 0:
            index = index_list.pop()
            add_data(x_list, y_list, data_file, index, augment=augment, augment_flip=augment_flip,
                     augment_distortion_factor=augment_distortion_factor, patch_shape=patch_shape,
                     skip_blank=skip_blank, permute=permute)
            if len(x_list) == batch_size or (len(index_list) == 0 and len(x_list) > 0):
                yield convert_data(x_list, y_list, n_labels=n_labels, labels=labels, num_model=num_model,overlap_label=overlap_label)
                x_list = list()
                y_list = list()

Can someone please tell me how to solve this issue? What causes the segmentation fault? Also, training is very slow. It takes about 7000s to complete one epoch.

@shifdz,
Please take a look on the links ref_1, ref_2. For your question on what causes segmentation fault, one of the answer in this thread mentions that "Segmentation fault error stands for a failure of the parallelization of your training process on the GPU"
We may need a simple reproducible code and sample data to trouble shoot the issue from our end. But I suggest you can try out the solutions mentioned in the links provided and let us know if it helps. Thanks!


epoll: Use libc_bitflags for EpollFlags

This is possible now that EPOLLEXCLUSIVE was added to libc in
https://github.com/rust-lang/libc/pull/526

@homu r+

:pushpin: Commit ac9f291 has been approved by fiveop

:zap: Test exempted - status


[Event Request] COD13 - OnBeforeCheckAccountType/OnBeforeCheckBalAccountType

Hello,
we Need 2 Events in COD13. One Event in procedure CheckAccountNo and one Event in procedure CheckBalAccountNo.

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.


python,misc: Add more hooks to pre-commit and update those we have

This is a draft. I'm playing around with these hooks to see which are of value are not (one commit per hook).

Closing this PR. It has been broken apart into the following PR:
#419
#420
#421
#422
#423
#424


Create RESTAPI for delete product and test cases

Added REST API for delete product and test cases

Looks good! Is your parts in model.py and route.py are both covered by test?


Suggestion re introducing sc_group vs sc_dataset

Extending discussion here: https://github.com/single-cell-data/matrix-api/issues/11

This would change the sequence and first introduce sc_group & sc_dataset and then talk about the specification within sc_group.
It would make identifications with existing formats on the level of sc_group and not on the level of the fields within sc_group.

There is also a question here regarding "allowing arbitrary collections of dataframes" vs. aligned multi-dimensional annotations (https://github.com/single-cell-data/matrix-api/issues/3).

Looks great. I agree that starting with descriptions of the higher-level components and including their anndata/seurat/bioc analogs will help readers get oriented more quickly.
Related but probably for a separate PR:

I think we should bump-up the matrix.png diagram to come before Notes:
and some of those bullets could be folded into the revised descriptions (e.g., There can be more than one X arrays...)

Thanks for this suggestion @falexwolf !

Thanks for merging! 😄


Create action group with email receiver with Azure CLI

I am attempting to create an action group with an email receiver using Azure CLI. Is there any documentation on the schema for the $receiver variable during az monitor action-group create --name $name --resource-group $rg --action $receiver?
I have attempted the following:
#!/usr/bin/env bash
rg='my-resource-group'
name='my-email-action-group'
receiver='{"emailAddress":"me@company.com","name":"adam-work-email"}'
az monitor action-group create --resource-group $rg --name $name --action $receiver #does not work
receiver='"emailAddress":"me@company.com","name":"adam-work-email"'
az monitor action-group create --resource-group $rg --name $name --action $receiver #also does not work
<EMAIL_ADDRESS>az monitor action-group create --resource-group $rg --name $name --action $receiver #also does not work
<EMAIL_ADDRESS>az monitor action-group create --resource-group $rg --name $name --action $receiver #also does not work

All of those commands fail with the following error:
usage error: Failed to parse<EMAIL_ADDRESS>as object of type<EMAIL_ADDRESS>usage error: the type<EMAIL_ADDRESS>is not recognizable.
Traceback (most recent call last):
  File "/opt/az/lib/python3.6/site-packages/azure/cli/command_modules/monitor/actions.py", line 287, in __call__
    self.deserialize_object(type_name, type_properties),
  File "/opt/az/lib/python3.6/site-packages/azure/cli/command_modules/monitor/actions.py", line 328, in deserialize_object
    raise ValueError('usage error: the type "{}" is not recognizable.'.format(type_name))
ValueError: usage error: the type<EMAIL_ADDRESS>is not recognizable.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/az/lib/python3.6/site-packages/knack/cli.py", line 197, in invoke
    cmd_result = self.invocation.execute(args)
  File "/opt/az/lib/python3.6/site-packages/azure/cli/core/commands/__init__.py", line 286, in execute
    parsed_args = self.parser.parse_args(args)
  File "/opt/az/lib/python3.6/argparse.py", line 1730, in parse_args
    args, argv = self.parse_known_args(args, namespace)
  File "/opt/az/lib/python3.6/argparse.py", line 1762, in parse_known_args
    namespace, args = self._parse_known_args(args, namespace)
  File "/opt/az/lib/python3.6/argparse.py", line 1950, in _parse_known_args
    positionals_end_index = consume_positionals(start_index)
  File "/opt/az/lib/python3.6/argparse.py", line 1927, in consume_positionals
    take_action(action, args)
  File "/opt/az/lib/python3.6/argparse.py", line 1836, in take_action
    action(self, namespace, argument_values, option_string)
  File "/opt/az/lib/python3.6/argparse.py", line 1133, in __call__
    subnamespace, arg_strings = parser.parse_known_args(arg_strings, None)
  File "/opt/az/lib/python3.6/argparse.py", line 1762, in parse_known_args
    namespace, args = self._parse_known_args(args, namespace)
  File "/opt/az/lib/python3.6/argparse.py", line 1950, in _parse_known_args
    positionals_end_index = consume_positionals(start_index)
  File "/opt/az/lib/python3.6/argparse.py", line 1927, in consume_positionals
    take_action(action, args)
  File "/opt/az/lib/python3.6/argparse.py", line 1836, in take_action
    action(self, namespace, argument_values, option_string)
  File "/opt/az/lib/python3.6/argparse.py", line 1133, in __call__
    subnamespace, arg_strings = parser.parse_known_args(arg_strings, None)
  File "/opt/az/lib/python3.6/argparse.py", line 1762, in parse_known_args
    namespace, args = self._parse_known_args(args, namespace)
  File "/opt/az/lib/python3.6/argparse.py", line 1950, in _parse_known_args
    positionals_end_index = consume_positionals(start_index)
  File "/opt/az/lib/python3.6/argparse.py", line 1927, in consume_positionals
    take_action(action, args)
  File "/opt/az/lib/python3.6/argparse.py", line 1836, in take_action
    action(self, namespace, argument_values, option_string)
  File "/opt/az/lib/python3.6/argparse.py", line 1133, in __call__
    subnamespace, arg_strings = parser.parse_known_args(arg_strings, None)
  File "/opt/az/lib/python3.6/argparse.py", line 1762, in parse_known_args
    namespace, args = self._parse_known_args(args, namespace)
  File "/opt/az/lib/python3.6/argparse.py", line 1968, in _parse_known_args
    start_index = consume_optional(start_index)
  File "/opt/az/lib/python3.6/argparse.py", line 1908, in consume_optional
    take_action(action, args, option_string)
  File "/opt/az/lib/python3.6/argparse.py", line 1836, in take_action
    action(self, namespace, argument_values, option_string)
  File "/opt/az/lib/python3.6/site-packages/azure/cli/command_modules/monitor/actions.py", line 297, in __call__
    ' '.join(values), type_name, str(ex)))
ValueError: usage error: Failed to parse<EMAIL_ADDRESS>as object of type<EMAIL_ADDRESS>usage error: the type<EMAIL_ADDRESS>is not recognizable.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c03d4ff4-4752-4ed4-2f6c-312ff3fd9fd8
Version Independent ID: 822e4b3b-4079-9a88-2525-715c8d4ea90a
Content: az monitor action-group
Content Source: src/command_modules/azure-cli-monitor/azure/cli/command_modules/monitor/_help.py
Service: monitoring-and-diagnostics
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

Please try out the format specified in the help:
Command
    az monitor action-group create : Create a new action group.

Arguments
    --name -n           [Required] : The name of the action group.
    --resource-group -g [Required] : Name of resource group. You can configure the default group
                                     using `az configure --defaults group=<name>`.
    --short-name                   : The short name of the action group.
    --tags                         : Space-separated tags in 'key[=value]' format. Use '' to clear
                                     existing tags.

Actions Arguments
    --action -a                    : Add receivers to the action group during the creation.
        Usage:   --action TYPE NAME [ARG ...]
        Email:   --action email bob<EMAIL_ADDRESS>        SMS:     --action sms charli 1<PHONE_NUMBER>
        Webhook: --action webhook alert_hook https://www.contoso.com/alert
        Multiple actions can be specified by using more than one `--action` argument.

Global Arguments
    --debug                        : Increase logging verbosity to show all debug logs.
    --help -h                      : Show this help message and exit.
    --output -o                    : Output format.  Allowed values: json, jsonc, table, tsv, yaml.
                                     Default: table.
    --query                        : JMESPath query string. See http://jmespath.org/ for more
                                     information and examples.
    --subscription                 : Name or ID of subscription. You can configure the default
                                     subscription using `az account set -s NAME_OR_ID`.
    --verbose                      : Increase logging verbosity. Use --debug for full debug logs.

The command does not accept JSON.


add PigPen to Cascading appliction frameworks

@fs111 Is this ok? It should fetch the current version at runtime so I don't have to keep it up to date (I'm really not good at keeping stuff like this up to date). If someone is developing pigpen, then this version will be nil and it'll fall back to "unknown". Is that ok or would you prefer a different default value?

That looks great. I was not sure how to get to the runtime version myself. This is def. better than my try.

NetflixOSS » PigPen » PigPen-pull-requests #10 SUCCESS
This pull request looks good


Is it possible to save the guid on another cloud server?

Is it possible to save the anchor's guid as json in firebase Storage and synchronize it on other devices?

Yes. After saving an anchor to the cloud and sharing it, you can share the guid using any format that works best for your project. We use Photon in this sample; however, firebase storage is another viable option.


Loads the window a little offscreen, closes with "has stopped working", reset my settings

i'm having a little issue here, the window is loaded a little off-screen for me, and if i close it, it says "Python has stopped working", also resets my settings.
i.e. I set to Intro before closing and it sets itself back to Beginner

The gui is still in beta, so I recommend the latest release. As for your concerns, yes the window is opening incorrectly at the moment and the window can be minimized but not closed once the bot is started, otherwise it will kill the bot..


[Draft] Don't include PhantomData fields in IdlBuild impl

Hi, I made this small change which addresses #3241 in order to be able to use a PhantomData field in an account.
It gets the IDL to build by filtering out PhantomData fields, however i have not tested it the other way, i.e., what happens if you want to encode a struct that includes a PhantomData field from a JS input.
Would like to know if this PR is acceptable as is, or what other changes need to be made also? For example:

[ ] Test that IDL definition does not include PhantomData fields
[ ] Signed Git commit
[ ] Some comments would be nice

Best

I think we also need to remove the generics that are only used by the PhantomData to make the definition valid. Otherwise, using declare_program! with this IDL would result in a compile error because Rust doesn't allow unused generic parameters.

How would I produce this error? The change is Works On My Machine(TM), because though the account struct has a generic param, it's only the impl that omits encoding the PhantomData field and rust allows that. Updated title.

I was going to push a minimal reproduction to this branch, but I was unable to do so because of this branch belonging to an organization fork. However, it's quite easy to reproduce; you can simply define a type that uses PhantomData:
#[derive(AnchorSerialize, AnchorDeserialize, Clone)]
pub struct PhantomStruct<T> {
    pub field: u32,
    _phantom: PhantomData<T>,
}

and use that type as a parameter to an instruction:
// Compilation test for whether `PhantomData` can be used with IDL
pub fn test_compilation_phantom_data(
    _ctx: Context<TestCompilation>,
    _phantom_struct: PhantomStruct<u8>,
) -> Result<()> {
    Ok(())
}

in this program.
Trying to build declare-program after updating external's IDL results in:
error[E0392]: type parameter `T` is never used
 --> programs/declare-program/src/lib.rs:5:1
  |
5 | declare_program!(external);
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^ unused type parameter
  |
  = help: consider removing `T`, referring to it in a field, or using a marker such as `PhantomData`
  = help: if you intended `T` to be a const parameter, use `const T: /* Type */` instead
  = note: this error originates in the macro `declare_program` (in Nightly builds, run with -Z macro-backtrace for more info)

error[E0282]: type annotations needed
 --> programs/declare-program/src/lib.rs:5:1
  |
5 | declare_program!(external);
  | ^ cannot infer type
  |
  = note: this error originates in the derive macro `Clone` which comes from the expansion of the macro `declare_program` (in Nightly builds, run with -Z macro-backtrace for more info)

error[E0282]: type annotations needed
 --> programs/declare-program/src/lib.rs:5:1
  |
5 | declare_program!(external);
  | ^ cannot infer type
  |
  = note: this error originates in the derive macro `Default` which comes from the expansion of the macro `declare_program` (in Nightly builds, run with -Z macro-backtrace for more info)

Some errors have detailed explanations: E0282, E0392.
For more information about an error, try `rustc --explain E0282`.
error: could not compile `declare-program` (lib) due to 3 previous errors

Ah, yes, I agree. I mentioned that possibility in my original comment. That still won't work.


Remove cgo imports

Close as the precision is not improved since 2015 https://github.com/golang/go/issues/9546


The plugin does not fail if it is unable to find a cloudformation export

example:
backend:
  http:
    baseUrl: !ImportValue my-not-existing-stack export

Results in:
Production URL | org.mozilla.javascript.Undefined@674ee6cc
Sandbox URL | org.mozilla.javascript.Undefined@674ee6cc

Ah, it was a nasty bug, can you review the PR?
https://github.com/ramgrandhi/serverless-wso2-apim/pull/56
ps: all bugs are nasty ;)


Show file size (MB) in installed apps view/updates available

File size shown on apps not installed, but not on app updates

Not in the shortcut, but when tapping on the app itself and installing as usual the file size does show