(BulkExtensions 6.5.6) Bulk Operation in Azure Function execution failure for severed relationship on BulkInsert

I'm not sure what code to provide other than a few details, don't know what, if any, Azure nuget packages are relevant

This is whichever of in/out of process is compared to what it was before 5.0 created the option (I think in process but I cannot remember)
This is reproducible locally only in the function, web server project execution shows no issue
Same SQL connection string to same database in both contexts

error

The association between entities '<parent, omitted>' and '<child, omitted>' with the key value '{PartnerRelationshipId: 10905}' has been severed, but the relationship is either marked as required or is implicitly required because the foreign key is not nullable. If the dependent/child entity should be deleted when a required relationship is severed, configure the relationship to use cascade deletes.

        public void BulkInsert<T>(IList<T> entities) where T : class
        {
            var dbEntries = entities.Select(z => Entry(z)).ToList();

            var config = new BulkConfig
                {
                    SetOutputIdentity = true,
                    TrackingEntities = true,
                };
            DbContextBulkExtensions.BulkInsert(this, entities, config);
        }

And it is only inserting 4 entities, and the first in the list has it's relationship on the EntityEntry as <null> in the Watch pin preview on thrown exception, but the navigation properties are populated with unchanged entities
db entries before save

db entries at exception thrown

And all of the foreign key navigation properties Entries are in state Unchanged
I'm at a loss of how to diagnose this further, I've tried clearing the context using the change tracker, iterating over the entities and detaching them all and re-adding them, nothing changes the resulting behavior
Transient or Scoped service lifetime for the DbContext injection doesn't seem to make a difference (which was suggested by the Azure team in previous runins with things working differently in Functions)
stack trace:
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.InternalEntityEntry.HandleConceptualNulls(Boolean sensitiveLoggingEnabled, Boolean force, Boolean isCascadeDelete)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.InternalEntityEntry.SetProperty(IPropertyBase propertyBase, Object value, Boolean isMaterialization, Boolean setModified, Boolean isCascadeDelete, CurrentValueType valueType)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.NavigationFixer.ConditionallyNullForeignKeyProperties(InternalEntityEntry dependentEntry, InternalEntityEntry principalEntry, IForeignKey foreignKey)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.NavigationFixer.ToDependentFixup(InternalEntityEntry dependentEntry, InternalEntityEntry principalEntry, IForeignKey foreignKey, Boolean fromQuery)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.NavigationFixer.InitialFixup(InternalEntityEntry entry, Boolean fromQuery)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.NavigationFixer.TrackedFromQuery(InternalEntityEntry entry)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.StartTrackingFromQuery(IEntityType baseEntityType, Object entity, ValueBuffer& valueBuffer)
   at Microsoft.EntityFrameworkCore.Query.QueryContext.StartTracking(IEntityType entityType, Object entity, ValueBuffer valueBuffer)
   at Microsoft.EntityFrameworkCore.Query.Internal.SplitQueryingEnumerable`1.Enumerator.MoveNext()
   at System.Collections.Generic.List`1..ctor(IEnumerable`1 collection)
   at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
   at EFCore.BulkExtensions.TableInfo.<LoadOutputDataAsync>d__200`1.MoveNext()
   at EFCore.BulkExtensions.SQLAdapters.SQLServer.SqlOperationsServerAdapter.<MergeAsync>d__5`1.MoveNext()
   at EFCore.BulkExtensions.SQLAdapters.SQLServer.SqlOperationsServerAdapter.<MergeAsync>d__5`1.MoveNext()
   at EFCore.BulkExtensions.SQLAdapters.SQLServer.SqlOperationsServerAdapter.Merge[T](DbContext context, Type type, IList`1 entities, TableInfo tableInfo, OperationType operationType, Action`1 progress)
   at EFCore.BulkExtensions.DbContextBulkTransaction.Execute[T](DbContext context, Type type, IList`1 entities, OperationType operationType, BulkConfig bulkConfig, Action`1 progress)
   at EFCore.BulkExtensions.DbContextBulkExtensions.BulkInsert[T](DbContext context, IList`1 entities, BulkConfig bulkConfig, Action`1 progress, Type type)
   at <omitted>.BulkInsert[T](IList`1 entities

I cannot isolate this to being specifically the fault of the extensions, at least not as reported
It's possible a prior bulk operation creates the conditions for this to happen but running change detection up and down execution, the failure never happens until these specific entities are saved or the navigation property entry is detached
I cannot make any sense of it

There is not enough info in the issue to make it reproducible.
Hope your solved it or found a workaround.
Will close it now, still if you manage to make a test with the issue you can write it here later.


Use OpenSSL to un/protect srtp packets and upgrade libsrtp to v2.1

Description
Upgrade libsrtp to 2.1 version. And use OpenSSL to protect and unprotect srtp packets.
[] It needs and includes Unit Tests
Changes in Client or Server public APIs
Not needed
[] It includes documentation for these changes in /doc.

make[2]: *** No rule to make target `/home/ubuntu/licode/build/libdeps/build/lib/libsrtp.a', needed by `erizo/liberizo.so'.  Stop.
make[1]: *** [erizo/CMakeFiles/erizo.dir/all] Error 2
make: *** [all] Error 2

You have to reinstall the dependencies (installUbuntuDeps).
Make sure you clean up the erizo build by removing licode/erizo/build
We are no longer including libsrtp in the repository and is now downloaded as part of the installation scripts

Make sure you clean up the erizo build by removing licode/erizo/build
that did the trick, thanks


Fix for upcoming deprecation in rtd

Read The Docs is making some changes that also affects our docs. This PR applies the changes proposed by rtd.
Further, I switched the domain from pygfx.com to pygfx.org, since that seems more common for open source projects.

Will pick this up later today or tomorrow. RTD is still validating certificates and DNS takes time to propagate globally.

Ok, docs.pygfx.org is now working, but I broke pygfx.com.

Pfew. All domain names seem to be resolved.


docs(-): git.timeout default is 5

I suggest common description about timeout. (default is xxxx)
https://cloud.spring.io/spring-cloud-config/reference/html/#_setting_http_connection_timeout

@seunggabi Please sign the Contributor License Agreement!
Click here to manually synchronize the status of this Pull Request.
See the FAQ for frequently asked questions.

@seunggabi Thank you for signing the Contributor License Agreement!


function string_agg(character varying, unknown) does not exist

Hello,
I'm trying out pg_search for the first time. I'm having a problem with multisearch.  I have two classes:
class Campaign
  include PgSearch

  has_many :people, :inverse_of => :campaign, :dependent => :destroy

  multisearchable :against => [:name, :description,]
  pg_search_scope :my_search, :associated_against => {
    :people => [:name, :description,],
  }
end

class Person
  include PgSearch

  belongs_to :campaign, :inverse_of => :person
  multisearchable :against => [:name, :description,]
end

When I try to run Campaign.my_search("blah"), the following error is raised:
irb(main):045:0*   Campaign.my_search("blah")
  Campaign Load (1.0ms)  SELECT "campaigns".*, (ts_rank((to_tsvector('simple', coalesce(pg_search_70d2fd3f153fc68f1f3ef9.pg_search_20d68b4f0ed15049488d61, '')) || to_tsvector('simple', coalesce(pg_search_70d2fd3f153fc68f1f3ef9.pg_search_21edc5203c6e93cdb8e5b9, ''))), (to_tsquery('simple', ''' ' || 'blah' || ' ''')), 0)) AS pg_search_rank FROM "campaigns" LEFT OUTER JOIN (SELECT "campaigns"."id" AS id, string_agg("people"."name", ' ') AS pg_search_20d68b4f0ed15049488d61, string_agg("people"."description", ' ') AS pg_search_21edc5203c6e93cdb8e5b9 FROM "campaigns" INNER JOIN "people" ON "people"."campaign_id" = "campaigns"."id" GROUP BY "campaigns"."id") pg_search_70d2fd3f153fc68f1f3ef9 ON pg_search_70d2fd3f153fc68f1f3ef9.id = "campaigns"."id" WHERE (((to_tsvector('simple', coalesce(pg_search_70d2fd3f153fc68f1f3ef9.pg_search_20d68b4f0ed15049488d61, '')) || to_tsvector('simple', coalesce(pg_search_70d2fd3f153fc68f1f3ef9.pg_search_21edc5203c6e93cdb8e5b9, ''))) @@ (to_tsquery('simple', ''' ' || 'blah' || ' ''')))) ORDER BY pg_search_rank DESC, "campaigns"."id" ASC
PGError: ERROR:  function string_agg(character varying, unknown) does not exist
LINE 1: ..." LEFT OUTER JOIN (SELECT "campaigns"."id" AS id, string_agg...
                                                             ^
HINT:  No function matches the given name and argument types. You might need to add explicit type casts.
 LEFT OUTER JOIN (SELECT "campaigns"."id" AS id, string_agg...
                                                             ^
HINT:  No function matches the given name and argument types. You might need to add explicit type casts.
: SELECT "campaigns".*, (ts_rank((to_tsvector('simple', coalesce(pg_search_70d2fd3f153fc68f1f3ef9.pg_search_20d68b4f0ed15049488d61, '')) || to_tsvector('simple', coalesce(pg_search_70d2fd3f153fc68f1f3ef9.pg_search_21edc5203c6e93cdb8e5b9, ''))), (to_tsquery('simple', ''' ' || 'blah' || ' ''')), 0)) AS pg_search_rank FROM "campaigns" LEFT OUTER JOIN (SELECT "campaigns"."id" AS id, string_agg("people"."name", ' ') AS pg_search_20d68b4f0ed15049488d61, string_agg("people"."description", ' ') AS pg_search_21edc5203c6e93cdb8e5b9 FROM "campaigns" INNER JOIN "people" ON "people"."campaign_id" = "campaigns"."id" GROUP BY "campaigns"."id") pg_search_70d2fd3f153fc68f1f3ef9 ON pg_search_70d2fd3f153fc68f1f3ef9.id = "campaigns"."id" WHERE (((to_tsvector('simple', coalesce(pg_search_70d2fd3f153fc68f1f3ef9.pg_search_20d68b4f0ed15049488d61, '')) || to_tsvector('simple', coalesce(pg_search_70d2fd3f153fc68f1f3ef9.pg_search_21edc5203c6e93cdb8e5b9, ''))) @@ (to_tsquery('simple', ''' ' || 'blah' || ' ''')))) ORDER BY pg_search_rank DESC, "campaigns"."id" ASC
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/connection_adapters/postgresql_adapter.rb:962:in `async_exec'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/connection_adapters/postgresql_adapter.rb:962:in `exec_no_cache'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/connection_adapters/postgresql_adapter.rb:551:in `block in exec_query'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/connection_adapters/abstract_adapter.rb:244:in `block in log'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activesupport-3.1.0/lib/active_support/notifications/instrumenter.rb:21:in `instrument'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/connection_adapters/abstract_adapter.rb:239:in `log'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/connection_adapters/postgresql_adapter.rb:550:in `exec_query'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/connection_adapters/postgresql_adapter.rb:1031:in `select'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/connection_adapters/abstract/database_statements.rb:18:in `select_all'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/connection_adapters/abstract/query_cache.rb:63:in `select_all'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/base.rb:470:in `find_by_sql'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/relation.rb:111:in `to_a'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/activerecord-3.1.0/lib/active_record/relation.rb:436:in `inspect'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/railties-3.1.0/lib/rails/commands/console.rb:45:in `start'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/railties-3.1.0/lib/rails/commands/console.rb:8:in `start'
        from /home/ericw/.rbenv/versions/1.9.2-p290/lib/ruby/gems/1.9.1/gems/railties-3.1.0/lib/rails/commands.rb:40:in `<top (required)>'
        from script/rails:6:in `require'
        from script/rails:6:in `<main>'irb(main):046:0>

ruby 1.9.2, rails 3.1.0, postgresql-8.4 (from ubuntu, including ubuntu's postgresql-contrib package)
Did I miss something in the documentation?
Thank you,
Eric

It's possible that this feature only works in PostgreSQL 9 and above. I will look into it.
I should add a note that pg_search has only been tested against PostgreSQL 9 to the README. My top priority right now is figuring out what is supported in PostgreSQL 8.x and documenting that to help avoid confusion.
Thanks for the feedback, and sorry that you've run into trouble.

I'm experiencing the same issue with postgres 8.4.8 with ubuntu, rails 3.0.8, and ruby 1.9.2. I'm not using multisearchable, but individual pg_search_scopes. The error only occurs on scopes in which I use associated_against. I notice that above, the problematic Campaign model is using associated_against to search through related tables...perhaps this is the source of the problem. In the meantime, will try upgrading to psql 9.

bartonmcguire: yeah I think that makes sense. We use string_agg() specifically to pull in the associated records' text. Upgrading to PostgreSQL 9 should definitely fix the issue. In the meanwhile, I'll search for an equivalent way that works against 8.x.

I am running into the same issue with postgres 9.0.2, rails 3.1 and ruby 1.9.2.  I am not using multisearch.  It just seems to happen with :associated_against.

I am using heroku cedar stack with a shared database and I am running into it with associated against.  Heroku's docs say i'm on psql 8.3.
On my local dev machine i am running psql 9.0.4 and it is working.

Ok, i have some temporary fixes for people struggling with this.  If you are on postgres > 8.3 but less than 9.x, you do not have the string_agg function, but you do have the array_agg function.    Luckily i found this:
http://wiki.postgresql.org/wiki/Array_agg
Since i want my solution to work on postgres 9.X on my local dev machine, i altered the name of the function within my rails migration:
https://gist.github.com/d79cbb380b95bd7d82a5
And I call my_array_agg within my patch:
https://gist.github.com/1285396
From what i've read, array_to_string with array_agg is not very efficient.  For me, it gets the job done until i upgrade to a dedicated db on heroku.
hope that helps!

Version 0.3.2 fixes this issue!
6cd7e268a4b21ecc82b8146fc4fce1b9c8cf80b2 Use array_to_string(array_agg()) in PostgreSQL 8.x

Cool.  I assume this doesn't work out of the box with Heroku shared database though, correct?  Just basing that assumption on the comments by @kbaum noting that pg 8.3 does not have array_agg.

Dont think it will work out of box with heroku.  Maybe it's worth putting up a page on the wiki about a work around?

Ah I see, I was working against PostgreSQL 8.4.9 when I made my fixes. I will look into which point version of 8.3 Heroku uses and do another pass at fixing bugs.

pg_search 0.3.3 fixes this issue.
I've backported array_agg to PostgreSQL 8.3 and earlier. You will need to generate a migration using
$ rake pg_search:migration:associated_against

Please give it a shot and let me know if it works against Heroku. I tested it against 8.3.11 locally which is what my Heroku app uses.

Awesome.. seems to work for me too!

I'm getting this error on v0.4 and v0.4.1 on heroku

I'm getting this error, any idea what might be the cause?
ActiveRecord::StatementInvalid (PGError: ERROR:  function array_agg(character varying) does not exist
LINE 1: ... JOIN (SELECT "users"."id" AS id, array_to_string(array_agg(...
                                                          ^
HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

@elfassy See the comment above https://github.com/Casecommons/pg_search/issues/13#issuecomment-2492613
You will need to generate a migration using
$ rake pg_search:migration:associated_against

Thanks! You are right, i had pushed my tables to heroku without running the migrations. That will teach me :) After running this migration on Heroku everything works!


go can't free memory immediately when uploading files

why go can't free memory  immediately when uploadHandle() is over.
func uploadHandle(w http.ResponseWriter, r *http.Request) {
	file, _, err := r.FormFile("file")
	if err != nil {
		log.Println(err)
		return
	}
	defer file.Close()

	t, err := os.Create("./" + "file")
	if err != nil {
		log.Println(err)
		return
	}
	defer t.Close()

	io.Copy(t, file)
	http.Redirect(w, r, "/", 302)
	return
}

ps:
go 1.4.2 x86/x86_64
go 1.3.3 x86/x86_64

Please use the golang-nuts@ mailing list for questions about Go. We only use the issue tracker for tracking bugs.


Add HHS and Nation to combo cases

Description
This ones a bit tricky since the signal combines usafacts and JHU. What I ended up doing was having hhs and nation process as if they were fips and then geomap them to the corresponding regions at the end. One thing to note was that the state and county values dont sum up to the same thing, not sure if thats expected due to JHU/USAFacts processing):
In [5]: df = pd.read_csv("receiving/20201218_county_confirmed_cumulative_num.csv")

In [6]: df.val.sum()
Out[6]: 17103973.0

In [7]: df = pd.read_csv("receiving/20201218_state_confirmed_cumulative_num.csv")

In [8]: df.val.sum()
Out[8]: 17167997

Changelog
Itemize code/test/documentation changes and files added/removed.

Add handling of hhs and nation conversion by adding having them retrieve the fips data and then geomap at the end. Update constants.

Fixes

Fixes #(issue)

+tests?

+tests?

+tests?

Just got around to updating them. Also ran the indicator and eyeballed the output files.

+tests?

Just got around to updating them. Also ran the indicator and eyeballed the output files.


community i18n

part of #100
Internationalization for the community page, submitting this live during a talk at Wrocław TypeScript  hopefully to spark some more contributions in this site & the typescript ecosystem in general!
hopefully we see some polish translations come through 😄

Woooo! Great work folks!


add Support Java Class with circular references

What changes were proposed in this pull request?

If the target Java data class has a circular reference, Spark will fail fast from creating the Dataset or running Encoders.
This PR will add an option for developer to decide whether they would like to skip the circular field, or leave the application to fail.
Why are the changes needed?

If the target Java data class has a circular reference, Spark will fail fast from creating the Dataset or running Encoders.
Does this PR introduce any user-facing change?

No.
How was this patch tested?

Issue: https://issues.apache.org/jira/browse/SPARK-33598

Can one of the admins verify this patch?

Hm, skipping them doesn't seem right either. Not sure if this should be an option; it is just something that doesn't make sense to encode

Hm, skipping them doesn't seem right either. Not sure if this should be an option; it is just something that doesn't make sense to encode

If it's a field the developer/application is comfortable with having self/circular reference, from Spark perspective I think it should allow the developer to stop the loop gracefully (which is to skip further processing the field in loop at developers' own judgement).
This PR is not to force for either way (stop the whole application immediately as existing or skip the filed if the developer choose to), but leave for the developer a choice to choose. Ultimately, it's the developer building their own application have best knowledge how to handle it.
I guess Spark probably assumed the circular reference must be a mistake made by the developers/application earlier. But it can really be a valid case even it could be rare.

Can you describe a valid use case? I can't think of one. Encoders are used with data classes, bean-like classes

Can you describe a valid use case? I can't think of one. Encoders are used with data classes, bean-like classes

Google Protobuf is an example, it's widely used as a data class. In the protobuf class, there is an attribute called Descriptor (this is a generated filed) which circular reference back.
Current spark implementation doesn't work with protobuf.
There are some other examples on the issue:
https://issues.apache.org/jira/browse/SPARK-33598

Hey All ,
Is there any update on this PR. I am currently running into an issue where I have a JSON schema that has circular references I am using Encoders.bean(classOf[Example.class]) to map the input to the POJO generated from that schema .it fails because of the circular reference

Hey all,
Wondering if this PR (or some similar fix got merged). I have similar issues with circular references and it would be great to have an option to skip the check.
Thanks.

Hi, I am having this circular reference problem while processing the Kafka avro messages with Spark 3.3.0.
Exception in thread "main" java.lang.UnsupportedOperationException: Cannot have circular references in bean class, but got the circular reference of class class org.apache.avro.Schema

https://github.com/apache/avro/blob/master/lang/java/avro/src/main/java/org/apache/avro/Schema.java

Still seems weird to me --
Does this happen to even be 'enough' for the protobuf case? Or does this extra unwanted descriptor field add other unneeded cols?
Is it 'too much' - Is it skipping real circular references that matter, but can't translate to tabular schemas?
Is it solvable by just subclassing the bean class and hiding the field that isn't desirable to begin with?
How does the circular ref arise in the avro case, different?
I get it just seems a bit too hacky as the 'right' solution. Sometimes hacks are worth it


PowerBI DOM XSS vulnerability

Update dependency to prevent dom XSS attacks
more details: https://developer.mozilla.org/en-US/docs/Web/API/Window/postMessage#security_concerns

this problem does not actually exist in the context of webworkers, there is no need for this code change


Add support for publications list

Description
Adds a section for a publication list. The layout is inspired from the template of LianTze Lim under Creative Commons as suggested in issue #6 .
This PR solves issue #6 .
Type of change

[x] New feature (non-breaking change which adds functionality)
[x] This change requires a documentation update: New screenshots could be made.

Checklist

[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation
[ ] I have checked that the original example is succesfully built on circleci

@darwiin could you review this PR and maybe merge it ? I think it constitutes a nice addition, especially for people in academia.

Hi @lambtho12, sorry for not merging your PR. I'm not familiar with Bibtex, do you know how to use it with french keywords for articles


Fix Twitter( X.com ) card previews not displaying correctly when sharing links.

Context
When sharing an article link from codu.co on x.com, the preview image does not appear in the card. Instead, a placeholder for an image is shown. This issue seems to be related to the Open Graph (OG) metadata tags on the website, which might not be set up properly or are being misread.
Expected Behavior
The social media post should display the relevant image from the Open Graph metadata on the article page.
Screenshots

Additional info
Verify that the correct Open Graph tags, particularly og:image, are set in the HTML of the page. Ensure that the image being referenced is publicly accessible and the URL is correct.

Hi @John-Paul-Larkin
I would like to work on this issue

Awesome Sidopolis. I have assigned you.

Hi @Sidopolis
How are you getting on with this?
Or will I reopen the issue for someone else?

Sir you can give to someone else

Hi @John-Paul-Larkin, I would like to work on this issue

Thanks @MichaelMoyles
I assigned you


Try to be fancy with csv

Checklist

[ ] I have added tests
[ ] I have updated the docs and cheatsheet
[ ] I have not broken the cheatsheet

@AndreasArvidsson I was mostly just curious if this was possible with Python's type system.  Feel free to reject if you feel it's too magical 😄.  I think it makes it a bit clearer which custom flags each csv is using, but the wrapper function is a bit of a doozy 😅

ok added docstring; merging into your PR


AMQP-791: Support JUnit5

JIRA: https://jira.spring.io/browse/AMQP-791

refactor BrokerRunning JUnit4 @Rule so it can be invoked from an ExecutionCondition.
Add @RabbitAvailable annotation with queue list and auto-delete queues at the end of the class; purge them between tests.

Tested further with a patch to the test in https://github.com/spring-projects/spring-amqp/pull/692 which I'll push after that is merged.

Final polishing for review.
TODO: docs


Terraform CLI Version
1.8.5
Terraform Provider Version
0.92.0
Terraform Configuration
I am facing issues with "enabled  = true" even it set to true when deploying it turn into false in state...

resource "snowflake_task" "test_task" {
  comment = "task with allow_overlapping_execution"

  database = "database"
  schema   = "schema"

  name          = "test_task"
  sql_statement = "select 1 as c;"

  allow_overlapping_execution = true
  enabled                     = true
}

Category
category:resource
Object type(s)
resource:task
Expected Behavior
enabled  = true should be true
Actual Behavior
enabled  = true should be true
Steps to Reproduce
deploy task with enabled  = true
How much impact is this issue causing?
High
Logs
No response
Additional Information
No response
Would you like to implement a fix?

[ ] Yeah, I'll take it 😎

Hey @olevenkov. Thanks for reaching out to us.
We are currently reworking tasks, I will add this to the list of known issues here: https://github.com/Snowflake-Labs/terraform-provider-snowflake/blob/main/v1-preparations/ESSENTIAL_GA_OBJECTS.MD.
From what I see, your definition does not contain any of SCHEDULE, AFTER, FINALIZE, or WHEN. Such tasks cannot be resumed in Snowflake; enabled just calls resume. You should see an error when running with environment variable TF_LOG=DEBUG (something like Task <name> should have a SCHEDULE, AFTER, FINALIZE or WHEN to be resumed.).

Hey @olevenkov 👋
Yesterday, we released a new provider version (v0.99.0) that contains a refactored snowflake_task resource. Please, try using it and let me know if the issue persists. Mind the breaking changes that happened in that change by reading the migration guide to adjust your configuration.

Hey @olevenkov
Are you able to confirm that the issue in not happening in the latest version of the provider?


Docs: Enrich tutorial section 5. Transfer data

We do have have multiple transfer tutorials in https://github.com/eclipse-tractusx/tutorial-resources/tree/main/mxd/docs


Syring after syringing blood discards collected blood's DNA

Description
Syring removes DNA from the entity's blood it took. No DNA on blood after spill liquid action on ForensicScanner.
On image with number 1 - took blood with syringe and spill it on floor, you can see DNA was removed
On image with number 2 - original blood had DNA

Reproduction
Get blood from Urist, make sure he really has DNA by using ForensicScanner.
Take syringe and took his blood (from his or from the floor) and spill liquid on the ground.
Scan blood with ForensicScanner, and you see that's no DNA on the blood.

Screenshots

Additional context
Discord post: https://discord.com/channels/310555209753690112/1229352457294057483/1229352457294057483

This is being fixed in https://github.com/space-wizards/space-station-14/pull/26699

This is being fixed in #26699

Hi, could you please mention my issue? So it issue'll close after PR is will be finished #26973
Thanks!

Confirmed fixed; thanks for the report.


PDF size from populated views too large - help wanted/bug

Some background:
Goal here is to download multiple filtered views as a pdf, ideally this should be done directly at a workbook level, but the filters don't work across the workbook.
Have browsed various suggested methods here and on the internet and the suggested approach was to filter each view seperately, download filtered view pdfs separately and merge them.
So approach is populate each view with applied filters, append them into a bytesIO stream and write to pdf.
Issue is this approach generates large pdfs from the views ~200KB resulting in an approx 1.8 MB pdf file (5 pages), alternatively doing so directly on the Tableau dashboard I can download multiple views (technically entire dashboard) in a smaller pdf ~ 917KB !
Code:
import pypdf as pdf
from io import BytesIO

pdflist=[]

for i in range(len(views)):
    server.views.populate_pdf(views[i],pdf_req_option)

writer = pdf.PdfWriter()

for j in range(len(pdflist)):

    stream = BytesIO(pdflist[j].pdf)
    writer.append(stream)

#---Compress and merge pdf

writer.write("filename.pdf")

In the upcoming 0.31 release you will be able to specify viz width and height when retrieving PDFs. #1348
This should allow you to more precisely control your output size and give an apples to apples comparison.

Thanks, well print to pdf paper type used is letter in both cases, even tried with type unspecified, so not sure how width/height is going to help here

We will fix the server issue of not filtering a workbook and have it available this year.
For a more immediate way to improve your exported pdfs, there are a lot of suggestions in this thread about compressing or optimizing pdfs including several python libraries.
https://stackoverflow.com/questions/59614014/pypdf4-exported-pdf-file-size-too-big

This has been implemented


Explicitly remove default namespace for Swagger UI

This removes the default (unused) API namespace to force Swagger UI not to display it.
Refer to https://github.com/IBM/MAX-Object-Detector/pull/16 for reference - this PR is the same change to be applied across all MAX repos where relevant.

When set to list, the Models section of the UI is expanded by default, like this:

Ideally we want to just have the model API namespace expanded, but not the Models list, like this:

Currently this is "all or nothing" via the Flask SWAGGER_UI_DOC_EXPANSION config (which can be none, list or full).
In Swagger-UI there is a JS parameter setting to expand the API namespace but collapse the Models list, but it's not exposed in Flask-Restplus. So we'll probably need a custom index.html for serving the Swagger UI that tweaks this param.
But I plan to play with it to figure out the best approach and then do a set of follow up PRs.


docs(test): 3397 Add E2E test documentation

#3397

Reviewers
Functional:
@nayib-jose-gloria
Readability:
@ebezzi
This PR adds E2E test documentation!
Please view the markdown below:
https://github.com/chanzuckerberg/single-cell-data-portal/tree/thuang-test-docs/frontend/tests
Please let me know if anything is unclear, missing, and/or can be refined 🙏
Thanks a lot!

Oh gosh, totally forgot about that smoke test section 😆 It's probably at least a year outdated, if not more 🤦 I'll add a link from that README to this new one, so we have one single source of truth! Thanks for pointing that out!

@nayib-jose-gloria done!


Unable to configure Spectral rule for oas3-valid-example

Using v0.53.1 with a .spectral.yaml
extends: "@ibm-cloud/openapi-ruleset"
rules:
  oas3-valid-example: error

results in:
[Info] Problem reading Spectral config file, using default IBM Spectral ruleset. Cause for error:
Cannot extend non-existing rule: "oas3-valid-example"

I am new to this validation library and Spectral so may be misunderstanding something but this rule does currently exist in Spectral's documentation and in IBM openapi-validator documentation so it seems like a user should be able to set it?

Hi @rparini - thanks for the issue. It looks like both our documentation and Spectral's documentation is out of date. Although they were quite unclear about it, Spectral separated this rule into the rules oas3-valid-media-example and oas3-valid-schema-example in their last major release.
This is hinted at in their migration guide although I see there is no mention of oas3-valid-example as part of the change. I confirmed these are the correct new rules in the source code for their ruleset.
Hopefully using these new rules resolves your issue. In the meantime, I will update our documentation.

Hi @dpopp07 thanks very much for the quick response and the links.  I'll make a similar issue on Spectral's repo to prompt them to update their documentation as well.
Happy for this issue to be closed, if you prefer, or for it to be left open until the IBM validator's documentation is updated.

Sounds good! I'll leave this open until I merge in the documentation changes. Thanks again


ARROW-12405: [Packaging] Fix apt artifact patterns and artifact uploading from travis

Builds: https://github.com/ursacomputing/crossbow/branches/all?query=build-242

Updated build for arm64 linux packages: https://github.com/ursacomputing/crossbow/branches/all?query=build-243

Verified that the artifacts are properly uploaded and named now.

Thanks!


Unhandled exceptions not reported to Bugsnag

Expected behavior
Exceptions are sent to Bugsnag.
Observed behavior
Lumen cannot find the Bugsnag driver. This message is thrown in the log:
[2020-09-14 09:55:28] laravel.EMERGENCY: Unable to create configured logger. Using emergency logger. {"exception":"[object] (InvalidArgumentException(code: 0): Log [] is not defined. at /home/agasigp/projects/web/lumen/vendor/illuminate/log/LogManager.php:192)
[stacktrace]
#0 /home/agasigp/projects/web/lumen/vendor/illuminate/log/LogManager.php(118): Illuminate\\Log\\LogManager->resolve()
#1 /home/agasigp/projects/web/lumen/vendor/illuminate/log/LogManager.php(98): Illuminate\\Log\\LogManager->get()
#2 /home/agasigp/projects/web/lumen/vendor/illuminate/log/LogManager.php(547): Illuminate\\Log\\LogManager->driver()
#3 /home/agasigp/projects/web/lumen/vendor/laravel/lumen-framework/src/Exceptions/Handler.php(56): Illuminate\\Log\\LogManager->error()
#4 /home/agasigp/projects/web/lumen/app/Exceptions/Handler.php(36): Laravel\\Lumen\\Exceptions\\Handler->report()
#5 /home/agasigp/projects/web/lumen/vendor/laravel/lumen-framework/src/Concerns/RegistersExceptionHandlers.php(103): App\\Exceptions\\Handler->report()
#6 /home/agasigp/projects/web/lumen/vendor/laravel/lumen-framework/src/Concerns/RoutesRequests.php(173): Laravel\\Lumen\\Application->sendExceptionToHandler()
#7 /home/agasigp/projects/web/lumen/vendor/laravel/lumen-framework/src/Concerns/RoutesRequests.php(108): Laravel\\Lumen\\Application->dispatch()
#8 /home/agasigp/projects/web/lumen/public/index.php(28): Laravel\\Lumen\\Application->run()
#9 /home/agasigp/.config/composer/vendor/cpriego/valet-linux/server.php(232): require('/home/agasigp/p...')
#10 {main}
"}

Steps to reproduce
I just make method in controller like this so it will throw FatalThrowableError syntax error :
public function index()
{
    return 'test'
}

Version

Lumen 6.3.3
Laravel bugsnag 2.20.0
PHP 7.4.9

Additional information

.env contains a valid Bugsnag API key (verified because manually reporting an exception does work), as well as LOG_CHANNEL=bugsnag, BUGSNAG_NOTIFY_RELEASE_STAGES=local, APP_ENV=local, and APP_DEBUG=true.
bootstrap/app.php has Bugsnag\BugsnagLaravel\BugsnagServiceProvider::class, registered before App\Providers\AppServiceProvider::class
config/logging.php has

return [
    'channels' => [
        'stack' => [
            'driver' => 'stack',
            'channels' => ['single', 'bugsnag'],
        ],
        ...
        'bugsnag' => [
            'driver' => 'bugsnag',
        ],
    ],
];

Hey @agasigp, it looks like all that's missing is a "default" log channel in your config/logging.php file
In our Lumen 6 example, there is a specified default channel which is used by the LogManager when it logs an error. The error message you're getting —  "Log [] is not defined" — implies that there is no default, as the name of the channel should be in the square brackets
So adding a default channel to config/logging.php should fix your issue:
return [
    'default' => env('LOG_CHANNEL', 'stack'),

    'channels' => [
        'stack' => [
            'driver' => 'stack',
            'channels' => ['single', 'bugsnag'],
        ],
        ...
        'bugsnag' => [
            'driver' => 'bugsnag',
        ],
    ],
];

I'd also generally recommend using stack as the log channel, rather than bugsnag. The bugsnag channel will only send reports to Bugsnag, whereas using stack will log errors to a file as well. Usually it's useful to have both, unless there's a specific reason why you only want errors reported to Bugsnag 🙂

Thanks for the explanation. Issue solved.


Parallel Scans not partitioning?

I have two (related) questions around postgres_scan and postgres_scan_pushdown.   I am testing these functions to fetch data from a Postgres read replica. I'm finding that the "parallelization" and TID scan stuff doesn't seem to work as advertised in the blog, but maybe I'm just not understanding how it works.
Consider the following example query:
select prediction_log_id from rep.tbl where created_at between '2022-09-30'::timestamp and '2022-10-01'::timestamp

(maybe irrelevant, but there is an index on created_at).
Now, I ran this in DuckDB using both functions to see how the extension works with/without predicate pushdown and I checked on the PG instance using:
SELECT pid, state, age(clock_timestamp(), query_start), usename, query from pg_stat_activity where query != '<IDLE>' and query not like '%pg_stat_activity%' and state='active' ORDER BY query_start desc;

With postgres_scan_pushdown, I get something like this:
COPY (SELECT "prediction_log_id" FROM "rep"."tbl" WHERE ctid BETWEEN '(13582000,0)'::tid AND '(13583000,0)'::tid AND ("created_at" >= '2022-09-30 00:00:00' AND "created_at" <= '2022-10-01 00:00:00' AND "created_at" IS NOT NULL)) TO STDOUT (FORMAT binary);

Frequently refreshing, the ctid range indeed increments by 1000 as the blog post indicates, but there isn't any parallel queries run, it's just 1 process.  Is that intentional?
With postgres_scan, I get something like this:
COPY (SELECT "prediction_log_id" FROM "rep"."tbl" WHERE ctid BETWEEN '(0,0)'::tid AND '(1000,0)'::tid ) TO STDOUT (FORMAT binary);

But this time I get three of these queries at a time, but they don't have different ctid ranges as I expected (like, literally the same exact query, three times).  So in this case, looks like there's parallelization, but you don't have separate ranges going on at once. Waiting a while and refreshing, I'd find a fresh new set of three queries with updated ctid ranges but all the same (eg. all updated from 0-1000 to 1000-2000).  Is that intentional?
Also interesting tidbit: after testing with different tables and queries, I find that the postgres_scan_pushdown function never starts with a 0-1000 CTID range, but somewhere in the middle. Does this mean the pushdown function is smarter with reading TIDs?
I am using DuckDB version 0.5.1, reading from PostgreSQL 10.18

Can you try with the latest version of postgres_scanner? We fixed some bugs related to this.

I just ran into the same when querying a view.  Would I need to build it myself from the source, or can I do some UNINSTALL cmd?
I did:
duckdb
INSTALL postgres_scanner;
LOAD postgres_scanner;

Ah yes, views are not yet supported.

Thanks for the report! This most likely has already been fixed, e.g. the following queries in DuckDB:
ATTACH 'dbname=postgresscanner' AS postgres (TYPE POSTGRES);
SET pg_debug_show_queries=true;
SELECT SUM(l_orderkey) FROM postgres.lineitem;

Result in the following Postgres queries:
COPY (SELECT "l_orderkey" FROM "public"."lineitem" WHERE ctid BETWEEN '(0,0)'::tid AND '(1000,0)'::tid) TO STDOUT (FORMAT binary);
COPY (SELECT "l_orderkey" FROM "public"."lineitem" WHERE ctid BETWEEN '(1000,0)'::tid AND '(2000,0)'::tid) TO STDOUT (FORMAT binary);
COPY (SELECT "l_orderkey" FROM "public"."lineitem" WHERE ctid BETWEEN '(2000,0)'::tid AND '(3000,0)'::tid) TO STDOUT (FORMAT binary);
COPY (SELECT "l_orderkey" FROM "public"."lineitem" WHERE ctid BETWEEN '(3000,0)'::tid AND '(4000,0)'::tid) TO STDOUT (FORMAT binary);
COPY (SELECT "l_orderkey" FROM "public"."lineitem" WHERE ctid BETWEEN '(4000,0)'::tid AND '(5000,0)'::tid) TO STDOUT (FORMAT binary);

Feel free to re-open if the issue persists.


What’s in the name?

Hm…, what does fhtagn stand for? I really want to start using it, but I don't think I'll be able to remember the name. Any mnemonics?

Please see this reply https://lobste.rs/s/bh44j5/fhtagn_tiny_cli_programs_tester_written#c_zwrw5t

Ah, so it's Lovecraftian. Thanks.
This also tells me where the name “R'lyeh”, that is used in N. K. Jemisin's fantastic novel ”The City We Became”, comes from.


reenabling escape syntax

Automated message from Dropbox CLA bot
@paxapy, it looks like you've already signed the Dropbox CLA. Thanks!

Just checked in with Tim who said this pull request is stuck waiting for him "needing to do careful testing with production data to make sure it doesn't unexpectedly change rendering of a lot more than it should", in case anyone watching this PR was wondering.


DATAJDBC-235 - Add support for configurable conversion.

We now support configurable conversion by introducing CustomConversions and RelationalConverter. CustomConversions is a registry for converters that should be applied on a per-type basis for properties. CustomConversions is typically registered as bean and fed into RelationalMappingContext and the newly introduced RelationalConverter to consider simple types and conversion rules.
RelationalConverter with its implementation BasicRelationalConverter encapsulates conversion infrastructure such as EntityInstantiator, CustomConversions, and MappingContext that is required during relational value conversion. BasicRelationalConverter is responsible for simple value conversion and entity instantiation to pull related code together. It's not in full charge of row result to object mapping as this responsibility remains as part of DataAccessStrategy.

Related ticket: DATAJDBC-235.

Merged. Thanks a lot.


triggering onSuggestSelect on all condition

Description
Fixes a bug mentioned in issue #193 where onSuggestSelect was not fired when geocoding was unsuccessfully.
Made changes to fire onSuggestSelect on all cases.
Checklist

[x] All tests passing
[x] Created tests which fail without the change (if possible)
[x] Commits and PR follow conventions

@yfr Hi, tests are working fine locally, am I missing anything?

Can't tell exactly what's going in the test should reset the active suggest when it disappears from the list on line 203 onActivateSuggest.args or onActivateSuggest.args[0] might not be ok.

@yfr This PR should solve issue #193 . Thoughts?

Looks fine to me. Thanks!


Regards,

Pull Request Test Coverage Report for Build 322

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 97.285%

Totals

Change from base Build 319:
0.0%

Covered Lines:
136

Relevant Lines:
140

💛  - Coveralls


Make header menu item clickable

What this PR does / why we need it:
Previously, we have to click on the link on the menu item to make it works, this PR makes the whole item clickable
before
https://user-images.githubusercontent.com/32532742/159645269-4cfbcd5d-e301-453a-8062-82c6778881d0.mp4
after
https://user-images.githubusercontent.com/32532742/159645342-a52108e9-539c-4fe2-9ee9-36a2f2cc88a0.mp4
Which issue(s) this PR fixes:
Fixes #
Does this PR introduce a user-facing change?:

NONE

I have just noticed that problem recently.
Nice fixing.
/lgtm

Nice catch!
/lgtm

/approve


Fix API references for OCP4.9 use

With OCP 4.9 the K8S version moved several API end points to v1 from v1beta1.
Unfortunately these changes mean that the playbook will not work on prior versions - if that's important, some trickery querying the OCP version to determine which API to use is needed (will have to be another PR).

thanks for this PR @bit4man, I adapted your fixes for supporting both situations: prior versions and 4.9+ in https://github.com/rcarrata/devsecops-demo/commit/69d44dbc20f5927a0334305c0e7291b7f6e51aea commit.
Testing in both versions ASAP and I'll update this PR.

Tested and working in < 4.9 and in >= 4.9:
$ bash install.sh
# INFO: Installing Demo

PLAY RECAP ********************************************************************************************************************
localhost                  : ok=72   changed=27   unreachable=0    failed=0    skipped=3    rescued=0    ignored=0

Fixed in https://github.com/rcarrata/devsecops-demo/pull/44 including your work and your fixes. Really appreciated your help @bit4man !!


Create ingressclassparameters_v1beta1.json

IngressClass CRD for Oracle Cloud based OKE clusters

Source of CRD: https://github.com/oracle/oci-native-ingress-controller/tree/main
used the crd extractor to generate the json


Refactor: Refactoring Temporary Image Resource storage

Rewrite the image resource storage to use the temporary directory instead of the current directory.
Further paragraphs come after blank lines.

Rewrite the lib/epub/reader that when it extracts the image resources, it will store them in the temporary directory which name is generated base on its path.
Rewrite the binded function in core/app.go that related to the image resource storage.
Modify the processing logic of opening files in the front-end: when a modification occurs, ask whether to save or not when opening other files.
Delete current temporary resources when the app is closed.

Bug that fixed:

Fixed the bug that when parsing the header element, the level of it can not be parsed correctly: the level of the header element is intergrated while the backend's definition is string.

Refactoring Temporary Image Resource storage


Suppress missleading warning

It's true that the function doesn't need any the receiver but this function is inside a DSL and the receiver helps to ensure that we always call it in the right scope.

Warnings

:warning:
It looks like this PR contains functional changes without a corresponding test.

  Generated by :no_entry_sign: dangerJS against 4178dfd8a34beabe8bf6eb31eeb9f40a1fd606d9


Crash on find match

Hello Team,
i have successfully deployed under development server and was testing a bit for this amazing thing. i found consistent crash on find match API for enclave. Also i am C/C++ developer and would like to take voluntary participate to help society.
OS : Ubuntu 18.08
Crash Log using gdb :
[New Thread 0x7ffff35e0700 (LWP 16394)]
Thread 1 "safetrace-app" received signal SIGSEGV, Segmentation fault.
0x00005555555efda0 in safetrace_app::networking::ipc_listener::handling::find_match ()

Hi @Embedded4development thanks for your interest in this project and your offer to help.
I'm in the process of documenting a number of things that need immediate work, and will link them here below. As you may guess one thing that needs more work that I'm aware is error management, so that in an instance like this, it would include a backtrace, and more details about the seg fault.
In the meantime and in order to help troubleshoot this issue, it would be great if you could post the data that you have loaded in the enclave, and the data that you are passing to find a match.
Thanks again 🙏

Hello @lacabra
i am passing following data :
module.exports.DataUser1 = [
{
"lat": 40.757339,
"lng": -73.985992,
"startTS":<PHONE_NUMBER>,
"endTS":<PHONE_NUMBER>,
"testResult": false,
},
{
"lat": 40.793840,
"lng": -73.956900,
"startTS":<PHONE_NUMBER>,
"endTS":<PHONE_NUMBER>,
"testResult": false,
},
]
module.exports.DataUser2 = [
{
"lat": 41.757339,
"lng": -73.985992,
"startTS":<PHONE_NUMBER>,
"endTS":<PHONE_NUMBER>,
"testResult": true,
},
{
"lat": 40.793840,
"lng": -73.956900,
"startTS":<PHONE_NUMBER>,
"endTS":<PHONE_NUMBER>,
"testResult": true,
},
]
As per Following example from index.js i am passing data as well as finding match too :
addData('user1', JSON.stringify(data.DataUser1));
addData('user2', JSON.stringify(data.DataUser2));
findMatch('user1');

ah, yes, I believe I know why this happens. I need to update the documentation on how to set up the environment. I believe it crashes because it's using incompatible versions. Let me document it better, and point you to the right docs... bear with me...

@Embedded4development look at the changes introduced in this PR #44, which I believe address the underlying issue you are seeing.
Specifically, this section summarizes the changes between your current setup, and the setup you should have to make this repo work. So you should:

Uninstall the SGX driver and the SDK that you have installed.

Reinstall the correct version of SGX and SDK (I'm copying the relevant lines from the INSTALL.md doc.

cd "$HOME/.sgxsdk"
wget https://download.01.org/intel-sgx/linux-2.6/ubuntu18.04-server/sgx_linux_x64_driver_2.5.0_2605efa.bin
wget https://download.01.org/intel-sgx/linux-2.6/ubuntu18.04-server/sgx_linux_x64_sdk_<IP_ADDRESS>363.bin
wget https://download.01.org/intel-sgx/linux-2.6/ubuntu18.04-server/libsgx-enclave-common_<IP_ADDRESS>363-bionic1_amd64.deb
wget https://download.01.org/intel-sgx/linux-2.6/ubuntu18.04-server/libsgx-enclave-common-dev_<IP_ADDRESS>363-bionic1_amd64.deb

chmod +x ./sgx_linux_*.bin

sudo ./sgx_linux_x64_driver_*.bin

echo yes | ./sgx_linux_x64_sdk_*.bin

dpkg -i libsgx-enclave-common_<IP_ADDRESS>363-bionic1_amd64.deb
dpkg -i libsgx-enclave-common-dev_<IP_ADDRESS>363-bionic1_amd64.deb
sudo apt install -y  libsgx-urts libsgx-uae-service libsgx-launch libsgx-ae-le autoconf libtool

please update /safetrace/app/Cargo.toml as well for incubator-teaclave-sgx-sdk path

Also, After running updated script on Ubuntu 18.04, sgx-detect is giving me following output :
`Detecting SGX, this may take a minute...
✔  SGX instruction set
✔  CPU support
✔  CPU configuration
✔  Enclave attributes
✔  Enclave Page Cache
SGX features
✘  SGX2  ✘  EXINFO  ✘  ENCLV  ✘  OVERSUB
Total EPC size: 93.5MiB
✘  Flexible launch control
✘  CPU support
✘  SGX system software
✘  SGX kernel device
✔  libsgx_enclave_common
✔  AESM service
✘  Able to launch enclaves
✘  Debug mode
🕮  SGX system software > SGX kernel device
The SGX device (/dev/sgx or /dev/isgx) is not present.
It appears you don't have the kernel module installed. Would you like to install it now?
(not supported yet)
(run with --verbose for more details)
More information: https://edp.fortanix.com/docs/installation/help/#sgx-driver
🕮  SGX system software > Able to launch enclaves > Debug mode
The enclave could not be launched.
(run with --verbose for more details)
More information: https://edp.fortanix.com/docs/installation/help/#run-enclave-debug
`

previously it was
✔  Able to launch enclaves
✔  Debug mode
✔  Production mode (Intel whitelisted)

Sharing output of updated SGX driver installation script here :
`script.sh: 3: script.sh: cannot open 16: No such file
script.sh: 3: script.sh: 18: not found
script.sh: 6: script.sh: cannot open 18: No such file
script.sh: 6: script.sh: 18: not found

#######################################
##### Installing missing packages #####
#######################################

Reading package lists... Done
Building dependency tree
Reading state information... Done
gdebi is already the newest version (<IP_ADDRESS>+nmu2).
lynx is already the newest version (2.8.9dev16-3).
parallel is already the newest version (20161222-1).
The following packages were automatically installed and are no longer required:
  gyp libjs-async libjs-jquery libjs-node-uuid libjs-underscore libsgx-ae-epid libsgx-ae-pce libsgx-ae-qe3 libuv1-dev node-ansi node-ansi-color-table node-archy node-async node-balanced-match
  node-block-stream node-brace-expansion node-builtin-modules node-combined-stream node-concat-map node-cookie-jar node-delayed-stream node-forever-agent node-form-data node-fs.realpath node-fstream
  node-fstream-ignore node-github-url-from-git node-glob node-graceful-fs node-hosted-git-info node-inflight node-is-builtin-module node-json-stringify-safe node-lockfile node-lru-cache node-mime
  node-minimatch node-mkdirp node-mute-stream node-node-uuid node-normalize-package-data node-npmlog node-once node-osenv node-path-is-absolute node-pseudomap node-qs node-read node-read-package-json
  node-request node-retry node-rimraf node-semver node-sha node-slide node-spdx-correct node-spdx-expression-parse node-spdx-license-ids node-tar node-tunnel-agent node-underscore
  node-validate-npm-package-license node-wrappy node-yallist python-cliapp python-markdown python-pygments python-ttystatus python-yaml
Use 'sudo apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 195 not upgraded.

################################################
##### Downloading Intel SGX driver and SDK #####
################################################

--2020-04-04 16:44:18--  https://download.01.org/intel-sgx/linux-2.6/ubuntu18.04-server/sgx_linux_x64_driver_2.5.0_2605efa.bin
Resolving download.01.org (download.01.org)... <IP_ADDRESS>, 2600:140f:4:684::4b21, 2600:140f:4:69f::4b21
Connecting to download.01.org (download.01.org)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 28686 (28K) [application/octet-stream]
Saving to: ‘sgx_linux_x64_driver_2.5.0_2605efa.bin.1’

sgx_linux_x64_driver_2.5.0_2605efa.bin.1           100%[================================================================================================================>]  28.01K  --.-KB/s    in 0.07s

2020-04-04 16:44:18 (383 KB/s) - ‘sgx_linux_x64_driver_2.5.0_2605efa.bin.1’ saved [28686/28686]

--2020-04-04 16:44:18--  https://download.01.org/intel-sgx/linux-2.6/ubuntu18.04-server/sgx_linux_x64_sdk_<IP_ADDRESS>363.bin
Resolving download.01.org (download.01.org)... <IP_ADDRESS>, 2600:140f:4:684::4b21, 2600:140f:4:69f::4b21
Connecting to download.01.org (download.01.org)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [application/octet-stream]
Saving to: ‘sgx_linux_x64_sdk_<IP_ADDRESS>363.bin.1’

sgx_linux_x64_sdk_<IP_ADDRESS>363.bin.1                  [                                    <=>                                                                          ]  18.47M  2.81MB/s    in 7.4s

2020-04-04 16:44:26 (2.49 MB/s) - ‘sgx_linux_x64_sdk_<IP_ADDRESS>363.bin.1’ saved [19370152]

--2020-04-04 16:44:26--  https://download.01.org/intel-sgx/linux-2.6/ubuntu18.04-server/libsgx-enclave-common_<IP_ADDRESS>363-bionic1_amd64.deb
Resolving download.01.org (download.01.org)... <IP_ADDRESS>, 2600:140f:4:684::4b21, 2600:140f:4:69f::4b21
Connecting to download.01.org (download.01.org)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1708000 (1.6M) [application/x-debian-package]
Saving to: ‘libsgx-enclave-common_<IP_ADDRESS>363-bionic1_amd64.deb.1’

libsgx-enclave-common_<IP_ADDRESS>363-bionic1_amd64. 100%[================================================================================================================>]   1.63M  1.78MB/s    in 0.9s

2020-04-04 16:44:27 (1.78 MB/s) - ‘libsgx-enclave-common_<IP_ADDRESS>363-bionic1_amd64.deb.1’ saved [1708000/1708000]

--2020-04-04 16:44:27--  https://download.01.org/intel-sgx/linux-2.6/ubuntu18.04-server/libsgx-enclave-common-dev_<IP_ADDRESS>363-bionic1_amd64.deb
Resolving download.01.org (download.01.org)... <IP_ADDRESS>, 2600:140f:4:684::4b21, 2600:140f:4:69f::4b21
Connecting to download.01.org (download.01.org)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 26688 (26K) [application/x-debian-package]
Saving to: ‘libsgx-enclave-common-dev_<IP_ADDRESS>363-bionic1_amd64.deb.1’

libsgx-enclave-common-dev_<IP_ADDRESS>363-bionic1_am 100%[================================================================================================================>]  26.06K  --.-KB/s    in 0.07s

2020-04-04 16:44:27 (358 KB/s) - ‘libsgx-enclave-common-dev_<IP_ADDRESS>363-bionic1_amd64.deb.1’ saved [26688/26688]

###############################################
##### Installing Intel SGX driver and SDK #####
###############################################

Unpacking Intel SGX Driver ... done.
Verifying the integrity of the install package ... done.
Installing Intel SGX Driver ...
/tmp/sgx-driver-JcjIC7 ~/.sgxsdk
install -d /opt/intel/sgxdriver/package
install -d /opt/intel/sgxdriver/scripts
install package/* /opt/intel/sgxdriver/package
install scripts/* /opt/intel/sgxdriver/scripts
~/.sgxsdk
/opt/intel/sgxdriver/package ~/.sgxsdk
make -C /lib/modules/5.3.0-42-generic/build SUBDIRS=/opt/intel/sgxdriver/package modules
make[1]: Entering directory '/usr/src/linux-headers-5.3.0-42-generic'
Makefile:227: ================= WARNING ================
Makefile:228: 'SUBDIRS' will be removed after Linux 5.3
Makefile:229:
Makefile:230: If you are building an individual subdirectory
Makefile:231: in the kernel tree, you can do like this:
Makefile:232: $ make path/to/dir/you/want/to/build/
Makefile:233: (Do not forget the trailing slash)
Makefile:234:
Makefile:235: If you are building an external module,
Makefile:236: Please use 'M=' or 'KBUILD_EXTMOD' instead
Makefile:237: ==========================================
  CC [M]  /opt/intel/sgxdriver/package/sgx_main.o
  CC [M]  /opt/intel/sgxdriver/package/sgx_page_cache.o
/opt/intel/sgxdriver/package/sgx_page_cache.c: In function ‘sgx_test_and_clear_young’:
/opt/intel/sgxdriver/package/sgx_page_cache.c:126:8: error: passing argument 4 of ‘apply_to_page_range’ from incompatible pointer type [-Werror=incompatible-pointer-types]
        sgx_test_and_clear_young_cb, vma->vm_mm);
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from /opt/intel/sgxdriver/package/sgx.h:72:0,
                 from /opt/intel/sgxdriver/package/sgx_page_cache.c:61:
./include/linux/mm.h:2678:12: note: expected ‘pte_fn_t {aka int (*)(struct <anonymous> *, long unsigned int,  void *)}’ but argument is of type ‘int (*)(pte_t *, struct page *, long unsigned int,  void *) {aka int (*)(struct <anonymous> *, struct page *, long unsigned int,  void *)}’
 extern int apply_to_page_range(struct mm_struct *mm, unsigned long address,
            ^~~~~~~~~~~~~~~~~~~
cc1: some warnings being treated as errors
scripts/Makefile.build:288: recipe for target '/opt/intel/sgxdriver/package/sgx_page_cache.o' failed
make[2]: *** [/opt/intel/sgxdriver/package/sgx_page_cache.o] Error 1
Makefile:1655: recipe for target '_module_/opt/intel/sgxdriver/package' failed
make[1]: *** [_module_/opt/intel/sgxdriver/package] Error 2
make[1]: Leaving directory '/usr/src/linux-headers-5.3.0-42-generic'
Makefile:16: recipe for target 'default' failed
make: *** [default] Error 2

Do you want to install in current directory? [yes/no] : Unpacking Intel SGX SDK ... done.
Verifying the integrity of the install package ... done.
Installing Intel SGX SDK ... done.
/tmp/sgx-sdk-ybRp2E ~/.sgxsdk
install -d /home/nishant/.sgxsdk/sgxsdk
cp -r package/* /home/nishant/.sgxsdk/sgxsdk
install -d /home/nishant/.sgxsdk/sgxsdk/scripts
install scripts/* /home/nishant/.sgxsdk/sgxsdk/scripts
chmod +x /home/nishant/.sgxsdk/sgxsdk/bin/sgx-gdb
~/.sgxsdk
uninstall.sh script generated in /home/nishant/.sgxsdk/sgxsdk

Installation is successful! The SDK package can be found in /home/nishant/.sgxsdk/sgxsdk

Please set the environment variables with below command:

source /home/nishant/.sgxsdk/sgxsdk/environment

##############################################
##### Installing additional dependencies #####
##############################################

deb [arch=amd64] https://download.01.org/intel-sgx/sgx_repo/ubuntu bionic main
OK
Hit:1 http://linux.teamviewer.com/deb stable InRelease
Hit:2 http://in.archive.ubuntu.com/ubuntu bionic InRelease
Get:3 http://in.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Ign:4 http://dl.google.com/linux/chrome/deb stable InRelease
Ign:5 https://repo.mongodb.org/apt/ubuntu bionic/mongodb-org/4.2 InRelease
Hit:6 https://repo.mongodb.org/apt/ubuntu bionic/mongodb-org/4.2 Release
Get:7 http://in.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Hit:8 https://dl.yarnpkg.com/debian stable InRelease
Hit:9 http://ppa.launchpad.net/linuxgndu/sqlitebrowser/ubuntu bionic InRelease
Get:10 http://in.archive.ubuntu.com/ubuntu bionic-updates/main amd64 DEP-11 Metadata [307 kB]
Hit:11 http://dl.google.com/linux/chrome/deb stable Release
Hit:13 http://ppa.launchpad.net/notepadqq-team/notepadqq/ubuntu bionic InRelease
Get:14 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Hit:15 https://download.01.org/intel-sgx/sgx_repo/ubuntu bionic InRelease
Get:16 http://in.archive.ubuntu.com/ubuntu bionic-updates/main DEP-11 48x48 Icons [73.8 kB]
Get:17 http://in.archive.ubuntu.com/ubuntu bionic-updates/main DEP-11 64x64 Icons [140 kB]
Get:18 http://in.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,061 kB]
Hit:19 http://ppa.launchpad.net/ubuntuhandbook1/audacity/ubuntu bionic InRelease
Hit:21 https://download.sublimetext.com apt/stable/ InRelease
Hit:22 http://ppa.launchpad.net/webupd8team/java/ubuntu bionic InRelease
Get:23 http://in.archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,012 kB]
Get:24 http://in.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 DEP-11 Metadata [273 kB]
Get:25 http://in.archive.ubuntu.com/ubuntu bionic-updates/universe DEP-11 48x48 Icons [204 kB]
Get:26 http://in.archive.ubuntu.com/ubuntu bionic-updates/universe DEP-11 64x64 Icons [472 kB]
Get:27 http://in.archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 DEP-11 Metadata [2,468 B]
Get:28 http://in.archive.ubuntu.com/ubuntu bionic-backports/universe amd64 DEP-11 Metadata [7,980 B]
Fetched 3,806 kB in 2s (1,534 kB/s)
Reading package lists... Done
Building dependency tree
Reading state information... Done
195 packages can be upgraded. Run 'apt list --upgradable' to see them.
--2020-04-04 16:44:46--  http://ftp.br.debian.org/debian/pool/main/p/protobuf/libprotobuf10_3.0.0-9_amd64.deb
Resolving ftp.br.debian.org (ftp.br.debian.org)... <IP_ADDRESS>, 2801:82:80ff:8000::4
Connecting to ftp.br.debian.org (ftp.br.debian.org)|<IP_ADDRESS>|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 680836 (665K) [application/x-debian-package]
Saving to: ‘/tmp/libprotobuf10_3.0.0-9_amd64.deb’

/tmp/libprotobuf10_3.0.0-9_amd64.deb               100%[================================================================================================================>] 664.88K   132KB/s    in 5.0s

2020-04-04 16:44:52 (132 KB/s) - ‘/tmp/libprotobuf10_3.0.0-9_amd64.deb’ saved [680836/680836]

Reading package lists... Done
Building dependency tree
Reading state information... Done
This package is uninstallable
A later version is already installed
dpkg: error: cannot access archive 'libsgx-enclave-common_<IP_ADDRESS>363-bionic1_amd64.deb': No such file or directory
dpkg: error: cannot access archive 'libsgx-enclave-common-dev_<IP_ADDRESS>363-bionic1_amd64.deb': No such file or directory
Reading package lists... Done
Building dependency tree
Reading state information... Done
autoconf is already the newest version (2.69-11).
libtool is already the newest version (2.4.6-2).
libsgx-ae-le is already the newest version (<IP_ADDRESS>-bionic1).
libsgx-launch is already the newest version (<IP_ADDRESS>-bionic1).
libsgx-uae-service is already the newest version (<IP_ADDRESS>-bionic1).
libsgx-urts is already the newest version (<IP_ADDRESS>-bionic1).
The following packages were automatically installed and are no longer required:
  gyp libjs-async libjs-jquery libjs-node-uuid libjs-underscore libsgx-ae-epid libsgx-ae-pce libsgx-ae-qe3 libuv1-dev node-ansi node-ansi-color-table node-archy node-async node-balanced-match
  node-block-stream node-brace-expansion node-builtin-modules node-combined-stream node-concat-map node-cookie-jar node-delayed-stream node-forever-agent node-form-data node-fs.realpath node-fstream
  node-fstream-ignore node-github-url-from-git node-glob node-graceful-fs node-hosted-git-info node-inflight node-is-builtin-module node-json-stringify-safe node-lockfile node-lru-cache node-mime
  node-minimatch node-mkdirp node-mute-stream node-node-uuid node-normalize-package-data node-npmlog node-once node-osenv node-path-is-absolute node-pseudomap node-qs node-read node-read-package-json
  node-request node-retry node-rimraf node-semver node-sha node-slide node-spdx-correct node-spdx-expression-parse node-spdx-license-ids node-tar node-tunnel-agent node-underscore
  node-validate-npm-package-license node-wrappy node-yallist python-cliapp python-markdown python-pygments python-ttystatus python-yaml
Use 'sudo apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 195 not upgraded.`

Replying to:
@lacabra please update /safetrace/app/Cargo.toml as well for incubator-teaclave-sgx-sdk path

Done in #49

Any update for other issues @lacabra ?

@Embedded4development, your driver installation failed in your script above. The error is here:
/opt/intel/sgxdriver/package/sgx_page_cache.c: In function ‘sgx_test_and_clear_young’:
/opt/intel/sgxdriver/package/sgx_page_cache.c:126:8: error: passing argument 4 of ‘apply_to_page_range’ from incompatible pointer type [-Werror=incompatible-pointer-types]
        sgx_test_and_clear_young_cb, vma->vm_mm);
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from /opt/intel/sgxdriver/package/sgx.h:72:0,
                 from /opt/intel/sgxdriver/package/sgx_page_cache.c:61:
./include/linux/mm.h:2678:12: note: expected ‘pte_fn_t {aka int (*)(struct <anonymous> *, long unsigned int,  void *)}’ but argument is of type ‘int (*)(pte_t *, struct page *, long unsigned int,  void *) {aka int (*)(struct <anonymous> *, struct page *, long unsigned int,  void *)}’
 extern int apply_to_page_range(struct mm_struct *mm, unsigned long address,
            ^~~~~~~~~~~~~~~~~~~
cc1: some warnings being treated as errors
scripts/Makefile.build:288: recipe for target '/opt/intel/sgxdriver/package/sgx_page_cache.o' failed
make[2]: *** [/opt/intel/sgxdriver/package/sgx_page_cache.o] Error 1
Makefile:1655: recipe for target '_module_/opt/intel/sgxdriver/package' failed
make[1]: *** [_module_/opt/intel/sgxdriver/package] Error 2
make[1]: Leaving directory '/usr/src/linux-headers-5.3.0-42-generic'
Makefile:16: recipe for target 'default' failed
make: *** [default] Error 2

Everything else looks good.
I just tried reinstalling this driver, and it works fine for me.
Can you try this newer version?
wget https://download.01.org/intel-sgx/sgx-linux/2.9/distro/ubuntu16.04-server/sgx_linux_x64_driver_2.6.0_95eaa6f.bin
chmod +x sgx_linux_x64_driver_2.6.0_95eaa6f.bin
sudo ./sgx_linux_x64_driver_2.6.0_95eaa6f.bin

Okay, so it was issue with full script.
i did it by following step by step script commands and everything works well.


Error: associated function _lift is private

Rust
I was stuck on this error for ages and after some trial and error managed to fix it by removing an enum from within a record and replacing it with a boolean, while being imports using 'with' in a child crate.
So, it seems there may be an issue with being able to correctly remap an interface to an interface generated in another package, when that interface contains a record that contains an enum.
I moved passed this by just hacking an approach using a bool

there might have been more to this because it seems fine in another case but it is weird behaviour anyway

Are you perhaps using a 0.24.0-or-earlier version of wit-bindgen? I think that https://github.com/bytecodealliance/wit-bindgen/pull/950 should have fixed this and that was released with 0.25.0

This fixed it thanks :)


Support SHA-2 blobrefs (migrate away from sha1-*)

Camlistore 0.9 should support something besides just SHA-1, like SHA-3. Should probably
then also make those use base64 blobrefs, instead of hex.

For case-insensitive file systems (Windows and OS X) you can put a special character after each upper-case letter. For example "sha3-a2B4C6d" becomes "sha3-a2B!4C!6d". It's easy to recover the original base64 by removing all "!". And the file name is still shorter 90% of the time than using only hex characters.

How will this affect detection of identical blobs? Will we compute both sha1 and sha3 to be sure (and possibly more in the future) or do we just give up and have same blob multiple times?

https://www.imperialviolet.org/2017/05/31/skipsha3.html

I'm leaning towards SHA-224

SHA-224 is a truncated version of SHA-256
why not use the full SHA-256?
why increase the risk of collisions, just to save a few bytes?


fix: update ui and set logdialogId from session

:tada: This PR is included in version 0.323.2 :tada:
The release is available on:

npm package (@next dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


[BUG] search detector API doesn't recognize _source field

ml-commons is using the similar way to build search APIs and we received one bug https://github.com/opensearch-project/ml-commons/issues/419.
I guess AD has the same issue.  Refer to the ml-commons issue for more details of root cause.
Related AD code AbstractSearchAction.java#L85

For returning Anomaly Detector’s in our search response we have additional logic to re-parse our response into an AnomalyDetector object in-order to keep the correct order of the response after excluding the ui_metdata. When we add _source to exclude/include specific fields it changes the order of the response by default. Because we have implemented this logic, if we add the ability for example to exclude timefield than we will fail in re-parsing the detector object.
The two ways to add the ability to use _source  is to write an additional AnomalyDetetctor parse method and find a non-redundant way to change toXContent to accommodate for the change while trying to keep the order or to stop caring about the order of the response body.
I believe adding this capability is not important enough to change the order of our response, so for now I’ll split up the issue into two issues and first release a bug fix for other search API’s (anomaly results, detector tasks)

@amitgalitz I understand that we take the raw responses & parse into AnomalyDetector objs, but what does this have to do with persisting any order? Also, our API doesn't ensure that they will be returned in any particular order: https://opensearch.org/docs/latest/monitoring-plugins/ad/api/#search-detector

@amitgalitz Can you forward port your changes to the main/3.0.0 branch?


xml version is too old

got this error when i tried to install pip_flutter
Because youtube_explode_dart >=1.12.0 depends on xml ^6.1.0 and every version of pip_flutter depends on xml ^5.3.0, youtube_explode_dart >=1.12.0
  is incompatible with pip_flutter.
So, because shintube depends on both youtube_explode_dart ^2.0.1 and pip_flutter any, version solving failed.

https://www.youtube.com/watch?v=g8ORJNbwffo


Issue with GPU in docker

Running the command docker run -it --rm --gpus all -p 7860:7860 --platform=linux/amd64 athomasson2/ebook2audiobookxtts:huggingface python app.py I get the following error:
docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].
I have an RTX 3070 ti, and my OS is Debian 12. Any Ideas what the issue might be?

Sorry for the unecessary issue. Some googling later, it turns out I did not have the Nvidia Container Toolkit installed yet. The guide I used: https://www.server-world.info/en/note?os=Debian_12&p=nvidia&f=2

oh nice well at last this information is here if anyone else runs into that lol 👍


Typescript error when using createMiddleware

This is a...

[X] :beetle: Bug Report
[ ] :rocket: Feature Request
[ ] :scroll: Documentation Request

Note: for support questions, please use stackoverflow with the redux-beacon tag. This repository's issues are reserved for feature requests and bug reports.
Which version of Redux Beacon are you using?

v1.2.1

Which target(s) are you using?

[ ] Google Analytics
[ ] Google Analytics (gtag)
[X] React Native Google Analytics
[ ] Google Tag Manager
[ ] React Native Google Tag Manager
[ ] Amplitude
[ ] Segment
[ ] Other/Third Party: ...(please specify here)

(If this is a bug report, feel free to delete the :scroll: and :rocket:
sections. Likewise, if this is a documentation or feature request, feel free to
delete the :beetle: sections)
:beetle: What are the steps to reproduce your issue?

Install v1.2.1 using Typescript
Create a GA middleware using instructions from docs: https://rangle.github.io/redux-beacon/docs/targets/react-native-google-analytics.html
Build

:beetle:  What did you expect to happen?
No errors.
:beetle: What happened instead?
Typescript throws error [ts] Argument of type 'void' is not assignable to parameter of type 'Target'.
:rocket: :scroll: What's missing from Redux Beacon that you'd like to add?
...Describe the feature or documentation you wish you had.
Can you help out?

[X] :star2: I am a legend and can get started on a pull request right away given the go-ahead.
[ ] :star: I am a superstar and would like to help out given some guidance.
[ ] :disappointed: I won't be able to help out on this one.

Actually, I guess this has already been fixed in the new code that hasn't been published to npm yet. Thanks! Looking forward to it.

I'll let you know once it's published! Should be soon, all I have is docs left to do :)

And....it's out! :slightly_smiling_face:
https://rangle.gitbook.io/redux-beacon/migration-guide-v1-to-v2


feat: adding an option for disabling query string encoding

We've discovered a bug where if your HAR definition has query strings that are already encoded (eg: startTime: 2015-09-15T14%3A00%3A12-04%3A00 instead of startTime: 2015-09-15T14:00:12-04:00), the library will re-encode them again when it constructs the urlObj and fullUrl data that a handful of targets use. This leads to those parameters values getting corrupted.
This PR adds a new argument, and option, to disable this escaping that happens on urlObj and fullUrl:
new HTTPSnippet(har, { escapeQueryStrings: true })

I've added a new query-encoded test case that covers this case for every available target.

Actually, nevermind!


docs rewrite

this thread is hidden but still needs resolving:
https://github.com/crate/crate-python/pull/290#discussion_r186154338

@chaudum pushed some fixeups. can you re-review please?
I've also left some comments of my own
and this thread is still unresolved, but it's been hidden in the github interface:
https://github.com/crate/crate-python/pull/290#discussion_r186154338

@chaudum this is ready for your review again! should all be fixed!

Looks good. Travis fails, though, because of blob.txt file not found.

@chaudum can you ack? tests pass now! :)


added sensitive data scanner support and initial lambda script

Closes: https://github.com/datadryad/dryad-product-roadmap/issues/3410

Tested from dev server:
Rails console input/output:
[8] pry(main)> StashEngine::DataFile.last.trigger_sensitive_data_scan
=> {:triggered=>true, :msg=>""}
[9] pry(main)> StashEngine::DataFile.last.pii_scan_report
=> #<StashEngine::PiiScanReport:0x00007f0e1b6636d8
 id: 1,
 report: "{\"report\": {\"errors\": [\"File type not supported\"], \"valid\": true, \"issues\": []}}",
 generic_file_id: 15739,
 status: "noissues",
 created_at: Tue, 22 Oct 2024 16:43:50.794666000 UTC +00:00,
 updated_at: Tue, 22 Oct 2024 16:43:50.794666000 UTC +00:00>

CloudWatch output:
  | 2024-10-22T19:46:02.265+03:00 | START RequestId: f8f43764-87b4-49bc-b2b8-960b0c443930 Version: $LATEST
  | 2024-10-22T19:46:02.265+03:00 | d14fdd0731203d47add2c27b81ea0340 - parsing file: https://dryad-s3-dev.s3.us-west-2.amazonaws.com/ce085816-4223/data/README.md
  | 2024-10-22T19:46:02.265+03:00 | d14fdd0731203d47add2c27b81ea0340 - callback_url: https://v3-dev.datadryad.org/api/v2/files/15739/piiScanReport
  | 2024-10-22T19:46:02.265+03:00 | d14fdd0731203d47add2c27b81ea0340 - end parsing with status: noissues
  | 2024-10-22T19:46:02.415+03:00 | END RequestId: f8f43764-87b4-49bc-b2b8-960b0c443930
  | 2024-10-22T19:46:02.415+03:00 | REPORT RequestId: f8f43764-87b4-49bc-b2b8-960b0c443930 Duration: 150.25 ms Billed Duration: 151 ms Memory Size: 128 MB Max Memory Used: 59 MB

Overall, looks good.
A few minor things to adjust:

The "coordinates" scanner is too loose -- it will match almost anything in a CSV file. Please remove it.
It needs cutoffs to ensure it works properly on larger files - when I submitted a file with 2000 issues, the report did not make it back to Dryad.
The names should be parallel. The name to run the report (trigger_sensitive_data_scan) should match the name to view the report (pii_scan_report)

@ryscher I updated and addressed all 3 comments.
I added CUTOFF_ERROR_COUNT = 20 and also returned in the report the run_time in seconds and finished flag so we know if the report finished parsing or not
All changes are uploaded on AWS Lambda


Google Cloud

Hello,
did somebody successfully trained yolact in the Google Cloud Platform ?
regards.
Ruwen

Yep,
I had to struggle a bit with the torch/cuda versions but after getting it right it worked

Alright Thanks!


Fix typos

What changes to the docs does this PR provide?
Fixing some types
PR Checklist
Please check if your PR fulfills the following requirements:

[X] Correctly picked the right branch to base the change off (dev for new features, main for typos/improvements)
[ ] For new pages, used the provided template
[ ] For new features, added an entry in the Table of Contents
[X] Ran against a spell and grammar checker
[X] Contains NO breaking changes

Docs Build status updates of commit 53b1695:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/mvvm/PuttingThingsTogether.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Hi @MisinformedDNA, sorry for the delay in looking at this PR. This doc has been migrated to our new docs repo: https://github.com/MicrosoftDocs/CommunityToolkit/blob/main/docs/mvvm/PuttingThingsTogether.md - would you mind checking if this fix still needs to be applied there? Thanks!


Initial code commit

Add basic readme
Setup project
Add basic code

Currently with this basic code, am getting an error trying to make the request:
Error fetching/parsing the given webpage: https://registration.experientevent.com/ShowMFS241/Flow/GUEST#!/registrant//RoomSearch/, error: Error: write EPROTO C43B0000:error:0A000152:SSL routines:final_renegotiate:unsafe legacy renegotiation disabled:c:\ws\deps\openssl\openssl\ssl\statem\extensions.c:922:

Swapped to use puppeteer instead of cheerio and this appears to fix all the issues and allows for clicking refresh button to get fresh data


[DX] Better apache authorization header "bug" handling

As mentionned by @arendjantetteroo in a precedent issue https://github.com/lexik/LexikJWTAuthenticationBundle/issues/23, Apache server will strip any Authorization header not in a valid HTTP BASIC AUTH format, causing the bundle to be useless in "header mode".
To work around the problem, 3 main approches exists :

[ ] Add rewrite rules to the VirtualHost (description here) : simple but needs server side intervention
[ ] Use the apache_request_headers php function to retrieve the original header (description here)

[ ] Inside a listener on the kernel.request event : fix the header bag but will be called on each request
[ ] Inside the AuthorizationHeaderTokenExtractor

For now I have documented the first solution, but it might not be the most DX-friendly. Adding the logic to extract the original header inside the AuthorizationHeaderTokenExtractor might be simpler for newcomers.
Does anybody have an opinion on this one ? Thanks !

Another, even easier solution in many cases is to simply add CGIPassAuth on to .htaccess.  See Apache docs and StackOverflow.  Worked for me, although I'm not using this bundle so your mileage may vary


Add section in docs about how to compile & use binaries

Needed: clear steps for people who want to compile the binaries, for example for Alpine or arm (related https://github.com/prisma/prisma/issues/1635)

We have instructions on how to build in the README here: https://github.com/prisma/prisma-engines#building-prisma-engines

But it’s only "half of it" because this only mention compiling but not how to use the binaries with the env vars

Best I found about the vars is the spec but there is so much stuff in there I’m afraid it could be confusing https://github.com/prisma/specs/blob/master/binaries/Readme.md#environment-variables

Duplicate of https://github.com/prisma/prisma/issues/1840?

kind of, not exactly :)


[Search] 2023-10-01-preview API Review feedback fixes - update swagger to reflect api renaming

Data Plane API - Pull Request
We realized that the swagger didn't have the correct naming for one of the properties, and was missing an extensible enum for the discriminator. Followup to #25862
API Info: The Basics
Most of the information about your service should be captured in the issue that serves as your API Spec engagement record.

Link to API Spec engagement record issue:

Is this review for (select one):

[ ] a private preview
[x] a public preview
[ ] GA release

Change Scope
This section will help us focus on the specific parts of your API that are new or have been modified. Please share a link to the design document for the new APIs, a link to the previous API Spec document (if applicable), and the root paths that have been updated.

Design Document:
Previous API Spec Doc:
Updated paths:

Viewing API changes
For convenient view of the API changes made by this PR, refer to the URLs provided in the table
in the Generated ApiView comment added to this PR. You can use ApiView to show API versions diff.
Suppressing failures
If one or multiple validation error/warning suppression(s) is detected in your PR, please follow the
Swagger-Suppression-Process
to get approval.
❔Got questions? Need additional info?? We are here to help!

 Contact us!
The Azure API Review Board is dedicated to helping you create amazing APIs. You can read about our mission and learn more about our process on our wiki.

💬 Teams Channel
💌 email

Click here for links to tools, specs, guidelines & other good stuff
Tooling

Open API validation tools were run on this PR. Go here to see how to fix errors
Spectral Linting
Open API Hub

Guidelines & Specifications

Azure REST API Guidelines
OpenAPI Style Guidelines
Azure Breaking Change Policy

Helpful Links

Azure DevTools Wiki

I'd like to reference the same reasoning for this breaking change review as the previous PR. This API is not publicly yet and the swagger was incorrect when it was merged.

This is an example of our intended shape which is being deployed.

@robertklee Why AzureOpenAIParameters.resourceUri is declared as string but not uri? Similarly for AzureOpenAIEmbeddingSkill.resourceUri and CustomVectorizerParameters.uri?
The generated code for these types treats them as string instead of Uri(see here).

I will ask Carey

@Careyjmac

@robertklee Why AzureOpenAIParameters.resourceUri is declared as string but not uri? Similarly for AzureOpenAIEmbeddingSkill.resourceUri and CustomVectorizerParameters.uri?
The generated code for these types treats them as string instead of Uri(see here).

Our API expects a string for these fields, though we do convert them to Uri in our domain models. Since the swagger should match our API, I think it makes sense to keep them as string here. If ya'll want to convert them to Uri in the SDK implementation that would make sense though. Note that a similar field also exists on the existing WebApiSkill (which is the skill version of the CustomVectorizerParameters).

I think all our swaggers get flagged for the same policheck errors. :(
My PR didn't affect those strings. Is there any way to get those permanently exempted?

Our API expects a string for these fields, though we do convert them to Uri in our domain models. Since the swagger should match our API, I think it makes sense to keep them as string here. If ya'll want to convert them to Uri in the SDK implementation that would make sense though. Note that a similar field also exists on the existing WebApiSkill (which is the skill version of the CustomVectorizerParameters).

@Careyjmac and @robertklee - I understand that these are string fields, but could we specify the format: uri to generate the Uri type for SDKs?

Added @ShivangiReja

My PR didn't affect those strings. Is there any way to get those permanently exempted?

@robertklee if you look at the checks summary and click the link, the error output should say something about exemptions. If not, check the root CONTRIBUTING.md file in this repo. Off hand, I don't know where the exemption doc lives but those are the places I'd check.

My PR didn't affect those strings. Is there any way to get those permanently exempted?

@robertklee if you look at the checks summary and click the link, the error output should say something about exemptions. If not, check the root CONTRIBUTING.md file in this repo. Off hand, I don't know where the exemption doc lives but those are the places I'd check.

@BevLoh @sazeesha098 as a heads up

@robertklee, key fields like VectorSearchVectorizer.name should be both required and readonly. Currently, I observe that the key fields are marked as required. Can we also include "readOnly": true for them?"

@weidongxu-microsoft could you please help merge this PR? I believe I've received the necessary signoffs.

@weidongxu-microsoft or @heaths if the PR looks good, could you or someone with write access please help us merge it? Thank you!

@heaths  please let us know if you can merge the PR


Direct animation to window translation

Description
The way window animations work currently is the following:

A resize cause is noticed
A single resize event is sent to the window, with the target coordinates
The output of the window is being continuously shown, while being stretched to fit the borders the resize animation describes

What I propose is to make a flag to make [certain] animations behave like the following: retrieve the target window size from the animation each frame and for each frame send a resizing event to the window, making it actually follow the animation. Because some software doesn't adapt to this well it wouldn't hurt to allow sending events every N frames, interpolating the rest the old way,  and/or a windowrule to toggle this for specific groups of windows.
The target behavior is something akin to what happens when you manually resize the window (by dragging)
What this hopes to accomplish is to get rid of the "flickering" caused by scaling suddenly changing when window drastically changes size.

I don't think this is a good idea overall... No OS / DE does this.

I mean OS/DEs generally don't really do animations the way Hyprland does so there's that...
I suppose it would be nice to see first and decide whether it's worth it second, but that's not how programming works. IMO it would be better for slower and/or more linear-like animations since currently the snap is already noticeable at 3s animation duration (if the curve is sane ofc) when toggling large tile into a small float.
May as well not be worth the hassle, but again, would be interesting to see.

we used to have a similar thing to what KDE does and it was heavily requested to be removed, thus it was.

we used to have a similar thing to what KDE does

What was the thing?

take a snapshot at the beginning of animation and render it on top of the new surface contents, fading out the old

I can see why people didn't want that one, it freezed a certain frame, which produces janky visuals when the contents are moving on their own, which wouldn't happen here.
I think it'd be nice to hear someone else's opinion on this

feel free to gather opinions


chore: version bump and examples updates

Why?

Dependencies versions need to be updated
The Flutter example needs to be updated to also support Desktop
The Dart examples should feature a complete Dart project

What?

I've updated dependencies
Created a new Dart project at example/dart_example
Updated the Flutter project at example/flutter_example

Types of Changes

Documentation change (change to update documentation)
General improvements (quality updates to improve the stability of the project)

Notes
With this update, the 1.0.0 version of the Flutter example for mobile, web and desktop builds will be added in the "Release" tab
Checklist

[x] I have provided a description of the proposed changes.
[x] I added unit tests for all relevant code.
[x] I added golden tests for all UI changes.
[x] I added documentation for all relevant code.

Codecov Report

Merging #34 (66a7862) into master (5fdd9d1) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##            master       #34   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           67        67
  Lines         3004      3004
=========================================
  Hits          3004      3004

Impacted Files
Coverage Δ

lib/src/system/utils/matrix/complex_matrix.dart
100.00% <ø> (ø)

lib/src/system/utils/matrix/real_matrix.dart
100.00% <ø> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5fdd9d1...66a7862. Read the comment docs.


Collect DOI information for folder

Description

Some of the folders will get a DOI associated to them, and in order to properly register that DOI certain information needs to be collected.
We require: https://github.com/CSCfi/metadata-submitter/issues/205 and https://github.com/CSCfi/metadata-submitter/issues/155 for this issue
DoD (Definition of Done)

DOI information either as part of creating a folder or as an additional step in the wizard (step which should only be enabled if the user has an intent of publishing the folder to get a DOI)
Testing

Unit and integration testing.

follow up issues created. Will close this.


MKL build failing for mkl_cpu_allocator.h header in file threadpool_device.cc

Problem
TensorFlow with MKL isn't building successfully.
Error Log
ERROR: /opt/tensorflow/tensorflow/core/BUILD:3034:1: C++ compilation of rule '//tensorflow/core:core_cpu_impl' failed (Exit 1)
In file included from tensorflow/core/common_runtime/threadpool_device.cc:38:
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:85:8: error: 'void tensorflow::MklSmallSizeAllocator::GetStats(tensorflow::AllocatorStats*)' marked 'override', but does not override
   void GetStats(AllocatorStats* stats) override {
        ^~~~~~~~
./tensorflow/core/common_runtime/mkl_cpu_allocator.h: In member function 'virtual void tensorflow::MklSmallSizeAllocator::ClearStats()':
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:92:12: error: 'struct tensorflow::AllocatorStats' has no member named 'Clear'
     stats_.Clear();
            ^~~~~
./tensorflow/core/common_runtime/mkl_cpu_allocator.h: In member function 'void tensorflow::MklSmallSizeAllocator::IncrementStats(size_t)':
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:101:12: error: 'struct tensorflow::AllocatorStats' has no member named 'max_bytes_in_use'; did you mean 'peak_bytes_in_use'?
     stats_.max_bytes_in_use =
            ^~~~~~~~~~~~~~~~
            peak_bytes_in_use
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:102:25: error: 'struct tensorflow::AllocatorStats' has no member named 'max_bytes_in_use'; did you mean 'peak_bytes_in_use'?
         std::max(stats_.max_bytes_in_use, stats_.bytes_in_use);
                         ^~~~~~~~~~~~~~~~
                         peak_bytes_in_use
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:103:12: error: 'struct tensorflow::AllocatorStats' has no member named 'max_alloc_size'; did you mean 'largest_alloc_size'?
     stats_.max_alloc_size =
            ^~~~~~~~~~~~~~
            largest_alloc_size
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:104:57: error: 'struct tensorflow::AllocatorStats' has no member named 'max_alloc_size'; did you mean 'largest_alloc_size'?
         std::max(alloc_size, static_cast<size_t>(stats_.max_alloc_size));
                                                         ^~~~~~~~~~~~~~
                                                         largest_alloc_size
./tensorflow/core/common_runtime/mkl_cpu_allocator.h: At global scope:
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:247:8: error: 'void tensorflow::MklCPUAllocator::GetStats(tensorflow::AllocatorStats*)' marked 'override', but does not override
   void GetStats(AllocatorStats* stats) override {
        ^~~~~~~~
./tensorflow/core/common_runtime/mkl_cpu_allocator.h: In member function 'void tensorflow::MklCPUAllocator::GetStats(tensorflow::AllocatorStats*)':
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:250:45: error: no matching function for call to 'tensorflow::Allocator::GetStats(tensorflow::AllocatorStats*)'
     large_size_allocator_->GetStats(&l_stats);
                                             ^
In file included from ./tensorflow/core/common_runtime/device.h:35,
                 from ./tensorflow/core/common_runtime/local_device.h:19,
                 from ./tensorflow/core/common_runtime/threadpool_device.h:20,
                 from tensorflow/core/common_runtime/threadpool_device.cc:16:
./tensorflow/core/framework/allocator.h:207:42: note: candidate: 'virtual absl::optional<tensorflow::AllocatorStats> tensorflow::Allocator::GetStats()'
   virtual absl::optional<AllocatorStats> GetStats() { return absl::nullopt; }
                                          ^~~~~~~~
./tensorflow/core/framework/allocator.h:207:42: note:   candidate expects 0 arguments, 1 provided
In file included from tensorflow/core/common_runtime/threadpool_device.cc:38:
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:255:12: error: 'struct tensorflow::AllocatorStats' has no member named 'max_bytes_in_use'; did you mean 'peak_bytes_in_use'?
     stats->max_bytes_in_use =
            ^~~~~~~~~~~~~~~~
            peak_bytes_in_use
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:256:17: error: 'struct tensorflow::AllocatorStats' has no member named 'max_bytes_in_use'; did you mean 'peak_bytes_in_use'?
         l_stats.max_bytes_in_use + s_stats.max_bytes_in_use;
                 ^~~~~~~~~~~~~~~~
                 peak_bytes_in_use
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:256:44: error: 'struct tensorflow::AllocatorStats' has no member named 'max_bytes_in_use'; did you mean 'peak_bytes_in_use'?
         l_stats.max_bytes_in_use + s_stats.max_bytes_in_use;
                                            ^~~~~~~~~~~~~~~~
                                            peak_bytes_in_use
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:261:12: error: 'struct tensorflow::AllocatorStats' has no member named 'max_alloc_size'; did you mean 'largest_alloc_size'?
     stats->max_alloc_size = l_stats.max_alloc_size;
            ^~~~~~~~~~~~~~
            largest_alloc_size
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:261:37: error: 'struct tensorflow::AllocatorStats' has no member named 'max_alloc_size'; did you mean 'largest_alloc_size'?
     stats->max_alloc_size = l_stats.max_alloc_size;
                                     ^~~~~~~~~~~~~~
                                     largest_alloc_size
Target //tensorflow/tools/pip_package:build_pip_package failed to build
Use --verbose_failures to see the command lines of failed build steps.

 Source build
Bazel version (if compiling from source): 0.19.0
GCC/Compiler version (if compiling from source): 8.2.0
CUDA/cuDNN version: NA
GPU model and memory: NA

@sadatnfs Thanks for submitting the issue. There is a fix that has been merged into master https://github.com/tensorflow/tensorflow/pull/25979

@sadatnfs can you try the fix and let us know if solved for you?

@nathan-greeneltch-intel oh shoot sorry yes it built all good! :)
I had an issue which I was using VERBS in my configs, but that's really not a big deal for me so I commented that out. MKL is all good!

fixed here - https://github.com/tensorflow/tensorflow/commit/dce9a49c19f406ba45919e8c94474e55dc5ccd54


Hide panel in Firefox after launching tab.

This is the last piece for fixing: https://github.com/uProxy/uproxy/issues/531 (which was surprisingly nearly done).

:+1:


Update the commons-io version to 2.17.0

Purpose
$subject

PR builder started
Link: https://github.com/wso2/product-is/actions/runs/11719181942

PR builder completed
Link: https://github.com/wso2/product-is/actions/runs/11719181942
Status: success


Add knob for Vertex Buffer Format

It was added a new Vertex Buffer that stores 16-bit floating point format for the vertex input including position, texCoord, normal and tangent.

I updated the code such that the function AppendVertexData is being templated instead of copying code.
I had an issue here since the class templated function AppendVertexData  implements a pure virtual function in the derived classes. I found a solution to address this issue. Let me know if this make sense. Ready for review.

I fixed the code such that the floats are mapped to a int8. It seems when we use the FORMAT_R8G8B8A8_SNORM , the shader maps values (int8 type) from [-128, 127] to [-1, 1], so I added a function to map a float between [-1, 1] to [-128, 127]. It should work because normal and tangents have all component values between [-1, 1]. Ready for review.

I rebased this PR. I think it is ready to be merged.

I rebased this PR. I think it is ready to be merged.

This PR doesn't compile for me (and the CI do break, so reassuring 😊 )

I fixed the issue producing the tests failed and replaced the function to convert a float to a 16-bits IEEE-754 with the glm version to avoid license issues. Ready to be merged.