delete me - issue was my issue - there is no way to delete my comment

[Enter feedback here]
delete me - issue was my issue
There is no delete button.
(.Time is added)
Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: f0ebe9e5-9a83-b5e6-5dd6-34c841cae021
Version Independent ID: 8c19161b-2eef-ecc9-37fe-5e665da9b2cb
Content: Common query patterns in Azure Stream Analytics - Azure Stream Analytics
Content Source: articles/stream-analytics/stream-analytics-stream-analytics-query-patterns.md
Service: stream-analytics
GitHub Login: @AliciaLiMicrosoft
Microsoft Alias: ali

@markjoh
Thanks for your feedback! We will investigate and update as appropriate.

@markjoh
Could you please elaborate on your query for better understanding?

For now, I tried to “recall” my submission of the bug because I didn’t have
time to verify it.  So, I was going to recall it, try to verify that I am
correct, then if I am, submit another bug.
My problem then changed to “I can’t recall or delete the bug”.   I didn’t
want to waste anybody’s time when I didn’t verify that I was correct.
So, ignore this bug until I verify it and, if I do find out I was correct,
another bug (or feedback) will be submitted.
Make sense?
On Sun, Nov 19, 2023 at 11:13 PM RamanathanChinnappan <
@.***> wrote:

@markjoh https://github.com/markjoh
Could you please elaborate on your query for better understanding?
—
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/azure-docs/issues/117156#issuecomment-1818356845,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AIGLHTNR7JRA2JV6TJ5KJGLYFL7KHAVCNFSM6AAAAAA7O2AIL6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMJYGM2TMOBUGU
.
You are receiving this because you were mentioned.Message ID:
@.***>

@markjoh
Understood. Thank you for letting me know. If there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.


conversion: use Copy on Write with InsertOrdered

The current behavior of InsertOrdered is to compute the commitment of any subtree as soon as it is determined that values will no longer be inserted. This is to save memory.
Because of this, toFr is called multiple times on a given node, and that is wasteful since toMultipleFr could be called if these subtrees were kept in RAM a bit longer. One idea would be to:

implement copy on write in InsertOrdered too
keep the current behavior of InsertOrdered at depth < 2
not flush nodes at greater depth unless their parent are flushed
use toMultipleFr to save on the division when serializing deeper nodes, hoping to benefit from the performance of serializing several points at the same time

@gballet, I think we can close this issue.

Indeed


"Applies to" tag should be implemented (consistently) across Security documentation

Docs such as copy-a-gpo-to-create-a-new-gpo.md contain a tag that verifies to which Windows versions the feature applies.

This very useful identifier is missing on many pages where it can be of significant use. Instead, some pages just list the last supported version of a feature in the title and header, which causes confusion due to the feature being supported on many older versions as well.
You can see this in the latest update to the event-4688.md documentation in PR #11001, where only "(Windows 10)" is listed in the title and header of the documentation, while in a different section it shows updates to the feature as far back as Vista.

I would also like to point out that some pages lack the checkmark emoji in the "Applies to" section, and also omit the appliesto tag and instead just write it down in a list like this.

Appreciate the feedback @ErrorRaffyline0. Some work is already being done on the Applies To tag, so expect to see some improvements gradually.

Are you sure this should be closed? The issue is also regarding replacing certain titles containing version names with appliesto tags in the text.

@ErrorRaffyline0 there's a broader effort to standardize AppliesTo across all articles in the Windows repo. This will be done in stages and it's already undergoing. I'm closing this to avoid unnecessary tracking. The articles that you read may be already updated or may get updated within the next couple of months.


Tomcat RedissonSessionManager with programatic config

Default way to of configuring tomcat with redis as session store is to modify the context.xml file as described here: https://github.com/redisson/redisson/blob/master/redisson-tomcat/README.md
With newer versions it's possible to also do it programatically, especially when running the app with embedded tomcat like so (Spring Boot):
...
 @Bean
    WebServerFactoryCustomizer<TomcatServletWebServerFactory> servletContainerCustomizer() {
        new WebServerFactoryCustomizer<TomcatServletWebServerFactory>() {
            @Override
            void customize(TomcatServletWebServerFactory container) {
                container.addContextCustomizers(new TomcatContextCustomizer() {
                    @Override
                    void customize(Context context) {
                            RedissonSessionManager redissonSessionManager = new RedissonSessionManager()
                            redissonSessionManager.setConfigPath("/path/config/redisson.conf")
                            redissonSessionManager.setReadMode('MEMORY')
                            redissonSessionManager.setUpdateMode("AFTER_REQUEST")
                            redissonSessionManager.setBroadcastSessionEvents(true)
                            redissonSessionManager.setBroadcastSessionUpdates(true)
                            context.setManager(redissonSessionManager)
                    }
                })
            }
        }
    }
...

The problem is the redisson.conf configuration. RedissonSessionManager does not allow to pass a programmatic configuration as described here.
Only path to a file is allowed.
Internally the file is parsed and Config object build.
Feature request
Extend RedissonSessionManager to accept config object as the configuration. This will allow to configure redisson fully programatically without the need to deal with files. This allows for much greater flexibility in different kind of environments and deployment/packaging modes.

I prepare a PR. If this is the right way, the changes should be copied also to tomcat10 and probably tomcat8. Official support in spring boot is for Tomcat 8.5 and above.


The port is running when I haved pressd "ctrl + c"

$: npm start ;
OK ,It working.
Then $:ctrl + c;
I edit my APP.js to "ctrl + s", but my  browser is changed also.
How to deal it? soory my english is poor.

.*..^/\ *01#.171 Okie!
Lmfao.
£5:
$: nm start ;
OK ,It working.
Than $:ctrl + c;
I edit my APP .KS to "ctrl + s", but my browser is changed also.
How to maintain?  Sorry people's edicate and ethics have gone out the
window with the'y 're morals; as it falls from grace and class within
status, factory limitations
(+:|×)
《☆★》
《♡♥》
《★☆》
《♥♡》.
On Thursday, 5 April 2018, superman<EMAIL_ADDRESS>wrote:

$: npm start ;
OK ,It working.
Then $:ctrl + c;
I edit my APP.js to "ctrl + s", but my browser is changed also.
How to deal it? soory my english is poor.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/facebook/create-react-app/issues/4258, or mute the
thread
https://github.com/notifications/unsubscribe-auth/ATut0VUlGSLzF_6UnsPzkaJSbDhANDIzks5tlX-PgaJpZM4THw3k
.

--
Megan B.M. Soo


Animation is over very fast

Expected Behaviour
Describe the expected behaviour.
The popped out confetti should slowly rain down
Actual Behaviour
Describe the actual behaviour.
The popped out confetti fastly rains down
Steps to Reproduce the Issue
I am using this in combination with https://github.com/joogps/SlideOverCard. The library is the problem, because I tried it already on my Home Screen and there it worked fine. I would like to ask if you could tell me a solution :)
https://user-images.githubusercontent.com/65811753/135335692-14b5076c-ccf7-4460-9cb5-82d383bbb0d8.mov

+1. Seeing same issue.

+1. Agree

Thanks @claytonsulby for submitting a solution 🙏


Invalid JSON generated by LogstashJsonFormatter when no properties on LogEvent

The LogstashJsonFormatter always appends a comma in the method WritePropertyAndValue.
This means if there are no items in the logEvent.Properties collection, then you end up with a trailing comma.
E.g.
{"timestamp":"2017-12-01T12:22:20.7748558+00:00","level":"Information","message":"My simple log message",}

Thanks for letting me know!
I can take a look at it this weekend (kids allowing :)) - happy to review a PR if you have time in the interim

Cool. 👍
I'm thinking the fix will be along the lines of this:
https://github.com/karlatkinson/Serilog.Sinks.Network/commit/60ed8b80663d8c41192b96b0f652573686bd3305
(sorry, VS has formatted the code so changes are a bit hidden).
Tried writing a failing test first though and seems like JSON.net annoyingly parses this happily :(
If you don't get round to it, i'll try and take a look next week.


当元素个数少于一个时候，loop参数配置为true会报错

Is not a bug, but this can be done automatically judge it?   thanks

@uncoder- I'm not really sure what you're asking for here and can't read the title. Any chance you could clarify for us? Thanks!

I just ran this through Google Translate. The title looks like "When the number of elements in less than one time, the parameters for the loop will complain".
I think this is fixed in our newest version @uncoder-. Can you try downloading the newest version from bower or http://smashingboxes.github.io/download/owl.carousel.2.0.0-beta.3.zip?

@greg5green
haha ,my english is poor,but maybe try it.
when The Elements in the container just has one element  and  opts set "loop:true",it is error in the browser "console" that said   "Uncaught TypeError: Cannot read property 'clone' of undefined"
sorry ,maybe you can understand?

I think this has been fixed in the latest version. I created a Codepen with a single element and loop: true and it seems to be working.

@thirdender   yes ,  it's  working

:)


Allow deletion of committees

Fix up cascades and sqlalchemy links so that deletion of committees works.
https://trello.com/c/5dLoX9Kb/327-remove-presidency-committee

There's still a bug here, don't merge.

Ok, merge away.


HHH-14097 Fix redundant SQLs issue for fetch entity graph

https://hibernate.atlassian.net/browse/HHH-14097
The root cause is we lack fetch entity graph validation. For the initial multiple hydrated objects, only the first one is applicable to root entity graph.
Imported andrea's testing code from https://github.com/hibernate/hibernate-orm/pull/3452. Tons of thanks to him!
Remember only the testing case is needed to be merged into v6 for entity graph implementation is incompatible between v5 and v6 and the code changes except the testing case are not needed in v6 (actually I've carefully deleted the v5 implementation in v6 previously).

in that case, the context will be set to null first then set to the upper
level context in line #285. I added 'on top level' for the comment already.
yeah, it is confusing. implementing fetch graph is sort if hacky in v5.
On Mon., Jul. 6, 2020, 10:55 Sanne Grinovero<EMAIL_ADDRESS>wrote:

@Sanne commented on this pull request.
In
hibernate-core/src/main/java/org/hibernate/engine/internal/TwoPhaseLoad.java
https://github.com/hibernate/hibernate-orm/pull/3453#discussion_r450279164
:

  		session.setFetchGraphLoadContext( fetchGraphContext );

  	}
  }

finally {

	// HHH-14097

	// Fetch entity graph should be applied only once on top level (for root hydrated object)

	// e.g., see org.hibernate.loader.Loader for details

	session.setFetchGraphLoadContext( null );

I'm not sure about this, are we entirely sure that the fetch graph is no
longer needed at this point?
Wouldn't it be possible for the fetch grapth to need to span multiple load
events?
IF this is correct, should line 285 be removed as it seems redundant?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/hibernate/hibernate-orm/pull/3453#pullrequestreview-443152034,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AB6UYAS4V7HMCGC77GVGWKLR2HQWBANCNFSM4OQLOSHQ
.

Hi @NathanQingyangXu  still not sure we really need session.setFetchGraphLoadContext( null ); as discussed privately I tried to add the kind of test you think may need this call
@Test
	public void testQueryByIdWithLoadGraph3() {
		Statistics statistics = entityManagerFactory().unwrap( SessionFactory.class ).getStatistics();
		statistics.clear();
		doInJPA(
				this::entityManagerFactory, entityManager -> {
					EntityGraph<AEntity> entityGraph = entityManager.createEntityGraph( AEntity.class );
					entityGraph.addAttributeNodes( "cList" );
					entityGraph.addSubgraph( "cList" ).addAttributeNodes( "a" );

					TypedQuery<AEntity> query = entityManager.createQuery(
							"select a from AEntity as a where a.id = :aid ",
							AEntity.class
					);
					query.setHint( GraphSemantic.LOAD.getJpaHintName(), entityGraph );
					query.setParameter( "aid", 1 );

					AEntity cEntity = query.getSingleResult();

					assertTrue( Hibernate.isInitialized( cEntity.getcList() ) );
					assertTrue( Hibernate.isInitialized( cEntity.getcList().get( 0 ) ) );

					assertEquals( 1L, statistics.getPrepareStatementCount() );
				} );
	}

if the test is correct, it passes with just
if ( fetchGraphContext != null && !fetchGraphContext.appliesTo( entity.getClass() ) ) {
			LOG.warnf( "Entity graph specified is not applicable to the entity [%s]. Ignored.", entity);
			fetchGraphContext = null;
}

Hi @NathanQingyangXu still not sure we really need session.setFetchGraphLoadContext( null ); as discussed privately I tried to add the kind of test you think may need this call
@Test
	public void testQueryByIdWithLoadGraph3() {
		Statistics statistics = entityManagerFactory().unwrap( SessionFactory.class ).getStatistics();
		statistics.clear();
		doInJPA(
				this::entityManagerFactory, entityManager -> {
					EntityGraph<AEntity> entityGraph = entityManager.createEntityGraph( AEntity.class );
					entityGraph.addAttributeNodes( "cList" );
					entityGraph.addSubgraph( "cList" ).addAttributeNodes( "a" );

					TypedQuery<AEntity> query = entityManager.createQuery(
							"select a from AEntity as a where a.id = :aid ",
							AEntity.class
					);
					query.setHint( GraphSemantic.LOAD.getJpaHintName(), entityGraph );
					query.setParameter( "aid", 1 );

					AEntity cEntity = query.getSingleResult();

					assertTrue( Hibernate.isInitialized( cEntity.getcList() ) );
					assertTrue( Hibernate.isInitialized( cEntity.getcList().get( 0 ) ) );

					assertEquals( 1L, statistics.getPrepareStatementCount() );
				} );
	}

if the test is correct, it passes with just
if ( fetchGraphContext != null && !fetchGraphContext.appliesTo( entity.getClass() ) ) {
			LOG.warnf( "Entity graph specified is not applicable to the entity [%s]. Ignored.", entity);
			fetchGraphContext = null;
}

I added a new testing case to showcase why session.setFetchGraphLoadContext( null ) is needed. It is hard to explain and even confusing, but it ensures that entity graph is disabled for scenario wherein it is not applicable.

Thanks @NathanQingyangXu for the additional test, may be I'm missing something but I tried it with just
GraphImplementor fetchGraphContext = session.getFetchGraphLoadContext();
		if ( fetchGraphContext != null && !fetchGraphContext.appliesTo( entity.getClass() ) ) {
			LOG.warnf( "Entity graph specified is not applicable to the entity [%s]. Ignored.", entity);
			fetchGraphContext = null;

		}

and it passes.

Thanks @NathanQingyangXu for the additional test, may be I'm missing something but I tried it with just
GraphImplementor fetchGraphContext = session.getFetchGraphLoadContext();
		if ( fetchGraphContext != null && !fetchGraphContext.appliesTo( entity.getClass() ) ) {
			LOG.warnf( "Entity graph specified is not applicable to the entity [%s]. Ignored.", entity);
			fetchGraphContext = null;

		}

and it passes.

Sorry for my premature pushing. Now I updated the testing case and I am confident it should be fine.

thanks! Merging


EncryptedString.verify is always resolving

I was a bit caught off guard by the way the verify() method for EncryptedStringField works. I expected it to either resolve the promise if the password is verified or reject it if not. I had to check the source to figure out that it actually always resolves (unless the hashing fails) and passes a boolean that says whether or not the verification is successful.
Would it be more intuitive if the method worked as in the following example?
user.password.verify(value).then(() => {
  console.log('Successfully verified the password');
}).catch(error => {
  console.log('Failed to verify');
});

I mean, the hashing should never fail. If it actually does, the password would not have been hashed in the first place (e.g. on user creation), and the verify method will not work anyway.

I think about password.verify as of function that returns boolean. You suggest that it should throw an exception. Technically not, but rejecting a promise is almost like an exception, especially in async-away world. In my opinion, it's a bit over-reaction on just a not valid password :)
And seriously, I don't want to introduce that kind of backward-incompatible change without really strong necessity.
But probably I have to describe EncryptedString.verify method in documentation.


how to set Content-Encoding: gzip for BULK Queries

In API version 27.0 and later, Bulk API can compress response data which reduces network traffic and improves response time. how do we set this option in jsforce?
Content-Encoding: gzip

Somewhat related... How do you set the response to a bulk query to JSON?  Appears there is support for this: https://releasenotes.docs.salesforce.com/en-us/spring16/release-notes/rn_api_bulk.htm#rn_api_bulk_json_support.xml?edition=&impact=

@cien-ben  and anyone else who run into this, as of this comment date
converting the query output stream to a different format is not supported.
From the docs
var fs = require('fs');
conn.bulk.query("SELECT Id, Name, NumberOfEmployees FROM Account")
  .stream().pipe(fs.createWriteStream('./accounts.csv'));

.stream() does not support converting from csv to other formats.
From http://jsforce.github.io/jsforce/doc/record-stream.js.html#line85
   throw new Error('Converting [' + type + '] data stream is not supported.');


[bugfix] Resolve TPU miss rdz

What does this PR do?

Fixes #<issue_number>
Before submitting

[ ] Was this discussed/approved via a GitHub issue? (not for typos and docs)
[ ] Did you read the contributor guideline, Pull Request section?
[ ] Did you make sure your PR does only one thing, instead of bundling different changes together?
[ ] Did you make sure to update the documentation with your changes? (if necessary)
[ ] Did you write any new necessary tests? (not for typos and docs)
[ ] Did you verify new and existing tests pass locally with your changes?
[ ] Did you update the CHANGELOG? (not for typos, docs, test updates, or internal minor changes/refactorings)

PR review
Anyone in the community is free to review the PR once the tests have passed.
Before you start reviewing make sure you have read Review guidelines. In short, see the following bullet-list:

[x] Is this pull request ready for review? (if not, please submit in draft mode)
[x] Check that all items from Before submitting are resolved
[x] Make sure the title is self-explanatory and the description concisely explains the PR
[x] Add labels and milestones (and optionally projects) to the PR so it can be classified

Did you have fun?
Make sure you had fun coding 🙃

@tchaton has been running this for a bit now and not seeing any crashes, so more stability for TPUs :)

@tchaton has been running this for a bit now and not seeing any crashes, so more stability for TPUs :)

@SeanNaren @tchaton This reminds me of Will's video on TPUs "We got it to work many times" 😂 Link


[AI Agent idea] A Mathemathics Prof. to help understand maths in a easier way.

Description
The AI as a Math Prof, helps student with math questions, offering clear explanations for better understanding.
Additional Information
Equation Solver
Glimpse

/assign @Alkaison

Hi @donqu1xotechina, I only received 1 badge for contributing AI Agent. Can you please check it ?
I guess it because the label Awesome AI agent isn't added to this PR #3131
Let me know what can I do to get the badge.


urls in style tags break

When I update element containing style urls I get weird results, for example:
<style>
  div {
    background-image: url(http://some.image.jpg)
  }
</style>

becomes:
<style>
  div {
    background-image: url(http:</style>

Am I missing something?

hah, didn't know someone is using this project, its an experiment, not battle tested, I would merge a pr though.

Cool, I'm happy to create one. Where would you start looking? ;)

Never mind, I found it. It's a problem with the serialize-html. The slashes seems to be treated as closing tags. I think an exception for style and script tags could do it since they can't have children anyways.

slashes are possible anywhere

True that, I thought they would get encoded by the browser parser for some reason.


Is there any method could get the last meaning digit ratio as step?

😥 Well, I don't know what‘s the correct definition for "the last meaning digit ratio", it just for example:
123 => 1
123.021 => 0.001
133.4500 => 0.01
2.0 => 1

There is no built-in method to do this, but it shouldn't be too difficult using the dp or decimalPlaces method:
For example
BigNumber.prototype.step = function () {
  return 10**-this.dp();
};

let x = new BigNumber('133.4500');
x.step();    // 0.001

x = new BigNumber('123');
x.step();    // 1


ecr + kaniko wip

Doesn't work yet.
I think we need to do this : https://docs.docker.com/registry/spec/auth/token/

Closing in favor of https://github.com/SubstraFoundation/substra-backend/pull/278


[SAGE-396] Alert foundations update

Description
Updates Alert component to match Figma design specs:

[x] remove border
[x] update primary color
[x] update icons
[x] update remaining buttons to use SageLink

Figma
Implementation Updates

Update 3 instances of secondary_action to appropriately use url prop.

Follow-up Items
N/A
Screenshots

Before
After

Testing in sage-lib

View Alert
Check that it matches Figma design specs

Testing in kajabi-products

(BREAKING) Updates Alert component to match Figma design specs. Adds new prop url for links.

Related
SAGE-396

@pixelflips Thanks for pointing out the close button hover style. I've removed it for now, but I'm consulting design on how we'd like to address this. For now, I'll file a follow-up ticket.

@pixelflips Thanks for pointing out the close button hover style. I've removed it for now, but I'm consulting design on how we'd like to address this. For now, I'll file a follow-up ticket.

Sounds great and I think a follow-up is just fine. :shipit:


bypass captcha

can you update it using anti-captcha or anycaptcha ?

great !! it's work right now. thanks

@kewka i am not able to run the comman do we need to enter our private key like this
$ docker run --rm kewka/give-me-bnb:hcaptcha give-me-bnb -key 7hsfjksfdsfkjsfh
or like this
$ docker run --rm kewka/give-me-bnb:hcaptcha give-me-bnb -key <7hsfjksfdsfkjsfh>
if i try the first one it goes on infinite loop like this

@kewka i am not able to run the comman do we need to enter our private key like this $ docker run --rm kewka/give-me-bnb:hcaptcha give-me-bnb -key 7hsfjksfdsfkjsfh or like this $ docker run --rm kewka/give-me-bnb:hcaptcha give-me-bnb -key <7hsfjksfdsfkjsfh> if i try the first one it goes on infinite loop like this

@Jaskaran546

What shell do you use? Try passing your key with --key 7hsfjksfdsfkjsfh or --key=7hsfjksfdsfkjsfh
7hsfjksfdsfkjsfh doesn't look like a valid private key. You'll get an error like this blockchain.ReadAccount: invalid hex character 'h' in private key

I added hcaptcha-challenger in b3f01c4 and pushed the kewka/give-me-bnb:hcaptcha docker image. It doesn't work on my mac m1 (arm64), but it works on windows or linux. Could you try this?
$ docker run --rm kewka/give-me-bnb:hcaptcha give-me-bnb -key <your private key>

They changed something @kewka. Currently I am getting this error:
captcha.New: CAPTCHA_RESPONSE not found

I added hcaptcha-challenger in b3f01c4 and pushed the kewka/give-me-bnb:hcaptcha docker image. It doesn't work on my mac m1 (arm64), but it works on windows or linux. Could you try this?
$ docker run --rm kewka/give-me-bnb:hcaptcha give-me-bnb -key <your private key>

They changed something @kewka. Currently I am getting this error:
captcha.New: CAPTCHA_RESPONSE not found

Fixed in f612495. Pull the docker image (docker pull kewka/give-me-bnb:hcaptcha) and try again

docker pull kewka/give-me-bnb:hcaptcha
yeah that was not a private key i just typed few words currently i am using this command $ sudo docker run --rm kewka/give-me-bnb:hcaptcha sh -c "while :; do give-me-bnb -proxy socks5://<IP_ADDRESS>:9050 -key ; killall -HUP tor; done"

One more thing can we use this to get eth also ?

docker pull kewka/give-me-bnb:hcaptcha
yeah that was not a private key i just typed few words currently i am using this command $ sudo docker run --rm kewka/give-me-bnb:hcaptcha sh -c "while :; do give-me-bnb -proxy socks5://<IP_ADDRESS>:9050 -key ; killall -HUP tor; done"

One more thing can we use this to get eth also ?

Yes, use the -currency parameter (possible values).
NOTE: You need BNB in your account to pay for gas fees.

@kewka is it possible to define the rpc where the collecting transaction is made against?

@kewka I am not able to create a PR from the source repo of the hcaptcha challange to your fork to update it again.

captcha.New: CAPTCHA_RESPONSE not found

happening again.

always CAPTCHA_RESPONSE not found.

@kewka always CAPTCHA_RESPONSE not found

I'm also getting captcha.New: CAPTCHA_RESPONSE not found. Any update?

Hey kewka, i am also getting this error: captcha.New: CAPTCHA_RESPONSE not found.

Hey, I've updated it 🙂
Pull the image (docker pull kewka/give-me-bnb:hcaptcha) and try again please. It still doesn't work on m1 (arm64).


Added unintended attributes in data files.

I did not intend to insert timestamp and layout attributes.
But it is sometimes added my comment data files abnormality. Can I know why it is occurred?
You can see the example like this:
https://github.com/mmistakes/made-mistakes-jekyll/blob/670807a0f8d41e15320c7913497f79c4af72aaf1/src/_data/comments/improving-jekyll-static-comments/comment-1488553821919.yml
It looks someone else have same problem.
https://github.com/eduardoboucas/staticman/issues/85
https://github.com/eduardoboucas/staticman/issues/91

The only fields Staticman may automatically add to an entry are _id and _parent. Any other fields must be coming from elsewhere, perhaps from the theme you're using.


Check if file exists prior to attempting to delete it

Hey!
We regularly notice
[14-Jul-2020 16:22:24 Europe/Dublin] PHP Warning:  unlink(E:\temp\tmp22ED.tmp.html): No such file or directory in E:\vendor\mikehaertl\php-tmpfile\src\File.php on line 60
Appearing in our logs. I had a look and line 60 and it's surroundings are:
/**
 * Delete tmp file on shutdown if `$delete` is `true`
 */
 public function __destruct()
 {
    if ($this->delete) {
        unlink($this->_fileName);
    }
 }

Can I suggest modifying it slightly to check if the file actually still exists before attempting to delete it? file_exists should work nicely.
/**
 * Delete tmp file on shutdown if `$delete` is `true`
 */
 public function __destruct()
 {
    if ($this->delete && file_exists($this->_fileName)) {
        unlink($this->_fileName);
    }
 }

Hmm, that's weird. I never had this issue and had no reports like this so far. The file is created and then deleted only here, so how can it not exist? It would be great if you could first debug this further, e.g. where else is the file deleted? Or does this maybe only happen under certain (error?) conditions?
If you can provide some more detail or even a short example to reliably reproduce it I can open an issue over at php-tmpfile.

Ok, let me dig a little further and I'll come back to you.
It's definitely not a 1-to-1 issue. PDFs are being generated en mass by our users without the error appearing in the logs. It's definitely the exception and not the rule. Sadly it doesn't come up following any other errors either.
Let me play around with it and see what I come up with.

Hey Mike.
So as an update. I went and changed the folder that the temp files from the default system temp folder, to a totally separate folder just for the PDF generation script. This seems to have caused the problem to go away, as it has totally stopped coming into the logs.
At a guess I would imagine some script on IIS is performing some sort of garbage collection in the default temp folder? If so, it might be worth the addition of the extra file_exists($this->_fileName).

Ok, I'm convinced. By it's nature a temporary directory is not guaranteed to not being deleted from some other process. And the system temp directory is the default. So I'll add the check.

@sentientsolutions I've just released 1.1.5 of php-tmpfile which contains this fix. Thanks for your help.


Change District Name in Google Sheet.

District Number 568: Thoothukkudi to Thoothukudi.
I thought this may affect map update problem.

This is related to #413

The name mentioned at https://github.com/covid19india/covid19india-react/blob/2a658276b6fc74a44657d9f01b4f14316b6833b3/public/maps/tamil-nadu.json?short_path=dc72922#L1643 is correct one(Thoothukudi).
So It's need to change in Google Sheets(It's named as Thoothukkudi).
Src: https://en.wikipedia.org/wiki/Thoothukudi_district
https://thoothukudi.nic.in/

Thanks. Yeah there are different spellings in different sources. We'll stuck to Thoothukkudi, the data will match the JSON in the coming release


[Feature] Add codecov to CI

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@df1f737). Click here to learn what that means.
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff           @@
##             main       #3   +/-   ##
=======================================
  Coverage        ?   37.20%
=======================================
  Files           ?        4
  Lines           ?       43
  Branches        ?        0
=======================================
  Hits            ?       16
  Misses          ?       27
  Partials        ?        0

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Blog-App: Add view

In this PR, the following is implemented

Implement the design from the sneak peek wireframes.

Use methods that created in the [Blog App - processing data in models

add some data to the database as described here.

thank you @ahmetbozaci


Naming families containing the prefixes "Extra", "Semi"

Hey folks,
We've recently started dealing with super families and the GF api cannot handle widths. Widths need to be separated into their own individual families, so Roboto Condensed is a different family to Roboto.

Menu screenshot of Roboto and Roboto Condensed
I'm wondering how we should treat variations of Condensed and Expanded families. Should it be
Extra Condensed or ExtraCondensed? These edge cases have not been specified in our naming doc. If we choose the CamelCase version, it will match out treatment of font styles, e.g: SemiBold, ExtraLight. If we choose the non CamelCase version, it will match similar family names from other foundries.

In Font Bakery, it likes the non CamelCase version. We have also let through Fira Sans Extra Condensed which is non CamelCase. We haven't had any complaints yet.
I'm uncertain whether either approach will lead to any complications? I'm assuming this is more a matter of styling.

Pablo had a nice idea to name widths in a way that sorts alphabetically....
Compact (Pablo used compressed but that's confusing with woff etc)
Condensed
Default [or nothing but that sorts to the top]
Expanded
Wide
The use of Semi and Extra makes a poor sort order.
Fb should also check width metadata is correct for such families btw
On Jan 31, 2017 10:09 AM, "Marc Foley"<EMAIL_ADDRESS>wrote:

Hey folks,
We've recently started dealing with super families and the GF api cannot
handle widths. Widths need to be separated into their own individual
families, so Roboto Condensed is a different family to Roboto.
[image: screen shot 2017-01-31 at 14 54 07]
https://cloud.githubusercontent.com/assets/7525512/22469825/2d4161e0-e7c5-11e6-8f9c-456167832315.png
Menu screenshot of Roboto and Roboto Condensed
I'm wondering how we should treat variations of Condensed and Expanded
families. Should it be
Extra Condensed or ExtraCondensed? These edge cases have not been
specified in our naming doc
https://docs.google.com/spreadsheets/d/1ckHigO7kRxbm9ZGVQwJ6QJG_HjV_l_IRWJ_xeWnTSBg/edit#gid=0.
If we choose the CamelCase version, it will match out treatment of font
styles, e.g: SemiBold, ExtraLight. If we choose the non CamelCase version,
it will match similar family names from other foundries.
[image: screen shot 2017-01-31 at 10 55 02]
https://cloud.githubusercontent.com/assets/7525512/22470186/5dc32136-e7c6-11e6-8b0f-f890633fe5d4.png
[image: screen shot 2017-01-31 at 10 53 33]
https://cloud.githubusercontent.com/assets/7525512/22470187/5dd95ece-e7c6-11e6-975a-b597ea04dd5e.png
In Font Bakery, it likes the non CamelCase version. We have also let
through Fira Sans Extra Condensed
https://fonts.google.com/specimen/Fira+Sans+Extra+Condensed which is
non CamelCase. We haven't had any complaints yet.
I'm uncertain whether either approach will lead to any complications? I'm
assuming this is more a matter of styling.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/googlefonts/fontbakery/issues/1211, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AAP9yyauRpflIUtgEbKjNQrXHsJG3i7wks5rX05sgaJpZM4LywFK
.

To answer the question, I think spaced rather than camel case is best for
family names, and a single camel case word best for style names
On Jan 31, 2017 10:36 AM, "Dave Crossland"<EMAIL_ADDRESS>wrote:

Pablo had a nice idea to name widths in a way that sorts
alphabetically....
Compact (Pablo used compressed but that's confusing with woff etc)
Condensed
Default [or nothing but that sorts to the top]
Expanded
Wide
The use of Semi and Extra makes a poor sort order.
Fb should also check width metadata is correct for such families btw
On Jan 31, 2017 10:09 AM, "Marc Foley"<EMAIL_ADDRESS>wrote:

Hey folks,
We've recently started dealing with super families and the GF api cannot
handle widths. Widths need to be separated into their own individual
families, so Roboto Condensed is a different family to Roboto.
[image: screen shot 2017-01-31 at 14 54 07]
https://cloud.githubusercontent.com/assets/7525512/22469825/2d4161e0-e7c5-11e6-8f9c-456167832315.png
Menu screenshot of Roboto and Roboto Condensed
I'm wondering how we should treat variations of Condensed and Expanded
families. Should it be
Extra Condensed or ExtraCondensed? These edge cases have not been
specified in our naming doc
https://docs.google.com/spreadsheets/d/1ckHigO7kRxbm9ZGVQwJ6QJG_HjV_l_IRWJ_xeWnTSBg/edit#gid=0.
If we choose the CamelCase version, it will match out treatment of font
styles, e.g: SemiBold, ExtraLight. If we choose the non CamelCase version,
it will match similar family names from other foundries.
[image: screen shot 2017-01-31 at 10 55 02]
https://cloud.githubusercontent.com/assets/7525512/22470186/5dc32136-e7c6-11e6-8b0f-f890633fe5d4.png
[image: screen shot 2017-01-31 at 10 53 33]
https://cloud.githubusercontent.com/assets/7525512/22470187/5dd95ece-e7c6-11e6-975a-b597ea04dd5e.png
In Font Bakery, it likes the non CamelCase version. We have also let
through Fira Sans Extra Condensed
https://fonts.google.com/specimen/Fira+Sans+Extra+Condensed which is
non CamelCase. We haven't had any complaints yet.
I'm uncertain whether either approach will lead to any complications? I'm
assuming this is more a matter of styling.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/googlefonts/fontbakery/issues/1211, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AAP9yyauRpflIUtgEbKjNQrXHsJG3i7wks5rX05sgaJpZM4LywFK
.

If we all agree to this, there are no changes needed. Any objections?

If no changes are needed, I suggest we close this. Reopen, please, if there's still any objection.


not certain the description is accurate

Do the driver folks believe ReceiveEvent must be set to TRUE for a storport virtual miniport driver?
In my experience setting to FALSE does not change the way the driver interacts with storport - even if set to TRUE storport never calls the ReceiveEvent callback in a storport vitual miniport driver.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: edda33b3-246f-1229-d613-79fcd7619de2
Version Independent ID: e7199ca7-bd33-9981-0b6b-99ee8024227e
Content: _VIRTUAL_HW_INITIALIZATION_DATA
Content Source: wdk-ddi-src/content/storport/ns-storport-_virtual_hw_initialization_data.md
Product: windows-hardware
GitHub Login: @windows-driver-content
Microsoft Alias: windowsdriverdev

Thanks for finding this, @BenWestbrook
@aahill can you verify and update the content accordingly?

Hi @BenWestbrook , apparently this field looks to be a holdover from an earlier implementation. Because of this, it's fine to set it to FALSE for storport virtual miniports. I'll update the documentation accordingly.
Thanks for bringing this to our attention!


Add some love to the layout

Work on Codebot layout to make it decent. Right now there are several sharp edges, e.g. tab bar is gray, editor is dark, etc.
I'm planning to mimic this awesome layout:

Fixed.


Independent timeouts per protocol

I think it might be hard to implement this using only the standard library's flag package. If you want to enable users to pass multiple protocols with custom configurations, it would be better to use a CLI framework like Cobra.
While I can generate flags like --tcp-timeout for every protocol, the command structure will quickly become unreadable without a proper tree structure for the commands


Add result level caching to Brokers

Based on proposal #4843 , this introduces result level caching in brokers. It uses the etag functionality to identify the existence of result cache for a specific query. This is independent of the segment level caching and therefore both types of caching can be configured independently. The result level cache is populated after the merge using the etag as the cache key and merged result set as cache value.
Since query results may be large, there is a configurable parameter resultLevelCacheLimit that limits the size of the query response that can be cached.

cool! Any chance you can get empirical evidence on the hit rates for this feature?

This is a neat feature but I don't know how much battle testing the etag computation code paths have. Some of the underlying code looks racy in ways that can cause hash computation failures. As such, since this is also a new feature, I suggest making sure the code paths will not touch any new code (or will immediately return null) unless this feature is enabled.

The racy part I'm not sure about is that the etag computation uses ServerSelector's pick() method, which may have an underlying change in discovery state after the initial server selection.

Also please make sure there's a coherent story on what thread is doing computation. It is a notoriously tricky thing to track, and cache populating is actually a very compute intensive operation.

@drcrallen I'm currently testing the changes on one of our internal clusters and should be able to give you a better response once it is done. I have marked this PR in progress for now.

@drcrallen current etag feature is being used in some druid clusters at Oath and some users have result level caches built using the etag feature outside of Druid already.  Result level Cache hit ratio typically various from 50% to 80% depending upon the use case.
Another major advantage of result level cache is that you cache finalized value of sketches rather than sketches themselves which take alot of space if stored inside cache.
Regarding thread used for computation, I think we should ensure that cache population activity happens inside the thread that calls ResultLevelCachingQueryRunner.run(..) (I think its gonna be the jetty thread) which should be introduced instead of changing CachingClientQueryRunner too much.

@drcrallen Could you please review the latest changes?

@drcrallen could you please review

Yes, I'll put it on my list.

Sweet! @a2l007 thanks for sticking this out.


Add quantized_maxpool_2d for xpu

Now we only support datatype of uint8(Byte). Referring the stock pytorch cpu implementation at code.
Waiting https://github.com/intel/torch-xpu-ops/pull/921 to be merged.

The specific unit test cases have passed in latest CI.
2024-11-07T09:10:50.0722836Z quantization/core/test_quantized_op_xpu.py::TestQuantizedOpsXPU::test_max_pool2d_nhwc_xpu PASSED [ 48%]
2024-11-07T09:10:50.1551494Z quantization/core/test_quantized_op_xpu.py::TestQuantizedOpsXPU::test_max_pool2d_pt2e_xpu PASSED [ 50%]
2024-11-07T09:10:50.5847030Z quantization/core/test_quantized_op_xpu.py::TestQuantizedOpsXPU::test_max_pool2d_xpu PASSED [ 51%]

Please fix ci error

Could we merge this? The CI failed with irrelevant cases. UT cases brought by this PR have passed.
2024-11-25T05:08:10.1156434Z quantization/core/test_quantized_op_xpu.py::TestQuantizedOpsXPU::test_max_pool2d_nhwc_xpu PASSED [ 48%]
2024-11-25T05:08:10.2177365Z quantization/core/test_quantized_op_xpu.py::TestQuantizedOpsXPU::test_max_pool2d_pt2e_xpu PASSED [ 50%]
2024-11-25T05:08:10.6525290Z quantization/core/test_quantized_op_xpu.py::TestQuantizedOpsXPU::test_max_pool2d_xpu PASSED [ 51%]

Please use TORCH_CHECK before launch kernels for dtype check.

Done.

Seems I have no access to merge this PR. @EikanWang  @fengyuan14  Could you please have a looks? Thanks!

@EikanWang  @fengyuan14 Sorry that I open auto-merge in mistake. The PR is merged once I approved the PR.... Could you please review the PR still? If there is other issue, we may open another PR to fix.

@gaopengff Since s8 output is allowed in recipe, quantized_max_pool2d needs to support s8 input.


Update copyright notice

List MO, Inc., as the copyright holder
Update years to include through 2017

Coverage remained the same at 93.324% when pulling c16c7e322b5c78bb6ae908ec03ecb77e608ea93e on JoeCohen:copr-update into bce1ebbb375065ffc6a6a1ea25af265c4654428e on MushroomObserver:master.


Make saved playlist names more useful

Currently the playlist saves as a timestamp and length. It'd be nice if the filename gave some indication of the contents. For example, compare the following:
1497984651-size_13-playlist.m3u
crash-course__computer-science__13.m3u

I'm currently trying this out (last two dirnames of the currently playing file):
local path = mp.get_property('path')
local cur_playing_basedirname = (path, "(.*/)(.*)/(.*)/(.*)", "%2__%3")
local savename = cur_playing_basedirname.."__"..length..".m3u"
local savepath = utils.join_path(settings.playlist_savepath, savename)

I removed the timestamp because I don't see any reason to want duplicates.
This works well for playlists contained in one directory (and using theloadfiles feature). It also allow combination with fzf for quickly fuzzy selecting a playlist.
This could be problematic if the playlist contains files from varying directories (I'm not sure that's even possible with the existing functionality of this script though).
Any interest?

This could be problematic if the playlist contains files from varying directories (I'm not sure that's even possible with the existing functionality of this script though).

It is possible if you meant saving playlists like that.

I removed the timestamp because I don't see any reason to want duplicates.

The purpose of the timestamp was to have a new playlist always in a predictable location, in the end of the list of playlists. I guess a human readable timestamp would be more useful though.
That said I agree some indication of content would be useful. I will take a look later if I figure out some universally good solution for it.

Changed timestamp to human readable in: aae4fbfee2da32cbf60353e7f63e8487c502f54a


User specified "custom" colormap

Is there a way to allow the client to specify a custom colormap "dynamically"?  For example, by providing a series of pixel+color pairs and dynamically generating a linear gradient colormap on the fly during rendering?
If such a capability doesn't exist, would you have any advice on how it might be best implemented?

Hey @blazetopher thanks for opening the issue.
Sadly there is no such capability, It was been in my mind for a long time now but I cannot think of a good way to do it.
I think there are 2 solutions:

the user provide the dynamic color_map info in each request

https://myendpoint/cog/preview?&url={myfile}&color_map={0: [0, 255, 255, 0], 2: ..., 3: ...}&color_map_type=linear|discrete

user define a colormap and POST it to the backend (which store it in a DB or in a shared drive like efs)

Solution 2 is really complex and might not even be possible, so solution 1 might be better. That's say I'm not 💯 on solution 1 because it will lead to really long/complex URL 🤷♂
ref: https://terracotta-python.readthedocs.io/en/latest/tutorials/categorical.html?highlight=colormap#in-the-frontend

@vincentsarago Thanks for the rapid response!
I was also thinking something along the lines of Option 1.  Our use case is relatively straightforward:  Only 3 colors and 2 splits - no gradients.  So while that case theoretically wouldn't be too bad, specifying every pixel value would get complex quickly.  Also sounds like there would potentially be encoding/decoding requirements (based on the terracotta reference) to take into consideration.
Thanks also for the pointer to the proper location in the codebase.  I'm unsure if our current project timeline will allow for it, but if we end up trying to implement and it comes out well, I'll be sure to submit a PR so it can be folded back in!

I think it would be fine to allow a colormap argument to not include all 255 colors, as long as it's understood the colors will be split evenly. So if you had 40 numbers in a row, that could define a colormap with 10 sections, and would be less of a URL burden. But with non-categorical colormaps only definining a few colors might not be possible.


Create v10 website version

Instead of creating a v11 staging branch, we are just going to create a website version for v10 and keep pushing v11 updates to the main branch.
Need to do a branch/deploy for the v10.carbondesignsystem.com website.
Based off of this slack conversation.

Thinking about this some more, it might be more confusing to have to send people back to v10. for current docs.
I'd propose we do the same thing we did for the v10 release, since we aren't completely rebuilding the website this time it should be much easier to sync the two branches.

Create new v11 or next branch that auto deploys to  v11.carbondesignsytem.com OR next.carbondesignsystem.com? I'd lean towards naming it v11, to not confuse things with Carbon Next. 😅
Keep pushing any content or regular website fixes etc to main/www
Pull new v11 content and releases into v11 branch, and keep synced with main branch fixes.

Thoughts @aagonzales @joshblack


tx_out two stake_address_id's for same address

OS
Your OS:
Versions
The db-sync version (eg cardano-db-sync --version): <IP_ADDRESS>
PostgreSQL version: 15.3
Build/Install Method
The method you use to build or install cardano-db-sync: inputoutput/cardano-db-sync:<IP_ADDRESS>-docker
Run method
The method you used to run cardano-db-sync (eg Nix/Docker/systemd/none): Docker
Additional context
I'm not sure this is an issue or not but AFAIK an address should be tight to a single stake_address_id. Am i wrong?
Please test the reported query in your end to make sure it's not an issue with my PSQL DB (v15).
Maybe is a rollback problem (as stated in the following lines).
Problem Report
A single address is reported to have more than one stake_address_id. Example:
select * from tx_out where address = 'addr1q8e9sjzdhw802nc5ukw95ew8vt2y427vgjhthq7jd2vsu0gx2dylerj6kgx37pp02z89f6tp3g200ju232nnepdffgaqzfn0ja' and stake_address_id IN (5198875, 5198915)

id
tx_id
index
address
stake_address_id
payment_cred

142886990
53316936
0
addr1q8e9sjzdhw802nc5ukw95ew8vt2y427vgjhthq7jd2vsu0gx2dylerj6kgx37pp02z89f6tp3g200ju232nnepdffgaqzfn0ja
5198915
0xF258484DBB8EF54F14E59C5A65C762D44AABCC44AEBB83D26A990E3D

142886994
53316936
4
addr1q8e9sjzdhw802nc5ukw95ew8vt2y427vgjhthq7jd2vsu0gx2dylerj6kgx37pp02z89f6tp3g200ju232nnepdffgaqzfn0ja
5198915
0xF258484DBB8EF54F14E59C5A65C762D44AABCC44AEBB83D26A990E3D

138834200
52041956
0
addr1q8e9sjzdhw802nc5ukw95ew8vt2y427vgjhthq7jd2vsu0gx2dylerj6kgx37pp02z89f6tp3g200ju232nnepdffgaqzfn0ja
5198875
0xF258484DBB8EF54F14E59C5A65C762D44AABCC44AEBB83D26A990E3D

Strange that only one of those stake_addreess_id's exists:
select * from stake_address where id IN (5198875, 5198915)

id
hash_raw
view
script_hash

5198915
0xE1065349FC8E5AB20D1F042F508E54E9618A14F7
stake1uyr9xj0u3edtyrglqsh4prj5a9sc598hew9g4feusk555wszhec3l

Maybe is an issue when rolling back or restarting dbsync in the middle of a transaction insert? If so, i guess your stake_address_id for stake1uyr9xj0u3edtyrglqsh4prj5a9sc598hew9g4feusk555wszhec3l will not be the same as mine.
If it helps to check your DB, the issue came out when trying to create a UNIQUE index on a custom MV which threw an error:
CREATE MATERIALIZED VIEW IF NOT EXISTS "mv_payment_address" AS
SELECT
  DISTINCT address,
  digest(address::BYTEA, 'sha256') as sha256,
  encode(address::BYTEA, 'hex') AS "hex",
  stake_address_id AS "stake_address_id",
  tx_out.address_has_script AS "addressHasScript",
  CASE
    WHEN tx_out.address_has_script IS TRUE THEN tx_out.payment_cred
  END AS "scriptHash",
  CASE
    WHEN tx_out.address_has_script IS NOT TRUE THEN tx_out.payment_cred
  END AS "paymentCredential"
FROM tx_out;

-------
CREATE UNIQUE INDEX IF NOT EXISTS unique_sha256 ON mv_payment_address (sha256);

My custom MV only have this issue with 2 addresses:
SELECT * FROM (
    SELECT
        DISTINCT address,
        COUNT(DISTINCT(stake_address_id)) AS count_stake_address_id
    FROM
        mv_payment_address
    GROUP BY
        address
) as _root
WHERE
    count_stake_address_id > 1

address
count_stake_address_id

addr1q8e9sjzdhw802nc5ukw95ew8vt2y427vgjhthq7jd2vsu0gx2dylerj6kgx37pp02z89f6tp3g200ju232nnepdffgaqzfn0ja
2

addr1qxkcqwk9lkjk8wer9xa6wgk8r30a2jncxwq0ay8tck4eyqsx2dylerj6kgx37pp02z89f6tp3g200ju232nnepdffgaqhykg7g
2

It's strange, i don't see any way to delete a row from stake_address table, also reflected at https://github.com/input-output-hk/cardano-db-sync/blob/master/cardano-db-sync/src/Cardano/DbSync/Cache.hs#L233-L234 . So the fact that i don't have an entry for on stake_address table for stake_address_id = 5198875 could be an inconsistency on my DB caused by a previously PSQL crash with loss of data.

Yes this is something that should never happen, since it shows a dangling reference. Could I ask how you synced db-sync? Did you use a snapshot? Upgraded it from a previous version?

100% new installation:
    image: inputoutput/cardano-db-sync:<IP_ADDRESS>-docker
    environment:
      - NETWORK=${NETWORK:-mainnet}
      - POSTGRES_HOST=postgres
      - POSTGRES_PORT=5432
      - RESTORE_SNAPSHOT=${RESTORE_SNAPSHOT:-}
      - RESTORE_RECREATE_DB=N
      - EXTRA_DB_SYNC_ARGS=--consumed-tx-out

If you can't think of any other possible cause of missing entries on stake_address i would attribute it to "client side (PSQL)" error and close the issue.
Or maybe its a starting point to create some sort of script to check the consistency of the DB to make sure others "don't face the same luck" or at least they can rely on 100% of the data inside their DBs. If some Wallet, App... use db-sync i would argue to have this "consistency check" scripts would be good to have.

Is it possible that some query interfered with normal execution of db-sync? I think it would be hard to do, ie it would require doing some insertions/updates. I wonder if this is somehow related to --consumed-tx-out which seems to be enabled.
I agreed on the consistency checks. The easiest way to check is to add a foreign key
ALTER TABLE "tx_out" ADD CONSTRAINT "tx_out_stake_address_id_fkey" FOREIGN KEY("stake_address_id") REFERENCES "stake_address"("id") ON DELETE CASCADE  ON UPDATE RESTRICT
which wouldn't work in your case. If it works drop it.

I don't think i had anything running interfering with db-sync. Maybe some tests i did refreshing of the custom MV mv_payment_address that since i didn't had a UNIQUE index the trigger threw errors, but i don't think it should cause this "loss of data" behavior...
CREATE OR REPLACE FUNCTION mv_payment_address_refresh()
  RETURNS trigger
  LANGUAGE plpgsql
AS $$
  BEGIN
    REFRESH MATERIALIZED VIEW CONCURRENTLY mv_payment_address;
    RETURN NULL;
  END;
$$;

CREATE TRIGGER mv_payment_address_trigger
    AFTER INSERT OR UPDATE OR DELETE
    ON tx_out
FOR EACH STATEMENT EXECUTE PROCEDURE mv_payment_address_refresh();

Also this (https://github.com/input-output-hk/cardano-db-sync/blob/master/cardano-db-sync/src/Cardano/DbSync/Era/Shelley/Insert.hs#L313 ) should always insert and/or extract the id of a specific stakeAddress. There should be "no way" to extract an incremental PK Id of a stake_address (which exists in the tx_out column) and lately not have the data a stake_address table.
Or... maybe there is? https://www.cybertec-postgresql.com/en/gaps-in-sequences-postgresql/
I'm thinking of a PSQL Rollback which lead to a gap in the stake_address table but db-sync continued using the PK id lately in the insert of tx_out row? I don't know much about how db-sync handles this inserts TBH...

Regarding consistency checks, i saw these migrations (which seems to be the same you pointed out):

tx_out fkey -> https://github.com/input-output-hk/cardano-db-sync/blob/master/schema/migration-2-0001-20211003.sql#L28
collateral_tx_out fkey -> https://github.com/input-output-hk/cardano-db-sync/blob/master/schema/migration-2-0013-20220505.sql#L12

Which maybe a rollback could lead to a delete on collateral_tx_out causing a cascade delete on stake_address but not on tx_out
But since there also exists a DELETE on them on a more recent migration i guess they are old and not in use (affecting in this issue):

https://github.com/input-output-hk/cardano-db-sync/blob/master/schema/migration-2-0022-20221020.sql#L13
https://github.com/input-output-hk/cardano-db-sync/blob/master/schema/migration-2-0022-20221020.sql#LL16C106-L16C106

Also checked and those FKeys don't exists on my DB, so this "should not be" what caused the issue. Testing the creation of it lead to expected error:
[2023-06-12 13:49:43] [23503] ERROR: insert or update on table "tx_out" violates foreign key constraint "tx_out_stake_address_id_fkey"
[2023-06-12 13:49:43] Detail: Key (stake_address_id)=(5198875) is not present in table "stake_address".

So i'm guessing periodically create and delete those FKeys should be enough for consistency checks.

Also regarding --consumed-tx-out i didn't check too much how it is implemented and if this could be the cause

Tested to force rollbacks on stake_address and tx_out AFTER INSERT and i saw gaps in PK id but no data inconsistency. Did not test further with possible Cardano.DbSync.Cache errors and rollbacks as also don't exactly know how this cache is implemented. I'm out of ideas. Also i don't save full logs of Docker to check what really happened.
Example:
CREATE OR REPLACE FUNCTION trigger_function()
RETURNS TRIGGER AS $$
BEGIN

  -- 5678840 current max synced stake_address_id
  if (NEW.stake_address_id IS NULL OR NEW.stake_address_id < 5678840) THEN RETURN NEW; END IF;

  RAISE WARNING 'Inserted row id: % %', NEW.id, NEW.stake_address_id;
  RAISE EXCEPTION 'Forced rollback requested after INSERT';
END;
$$ LANGUAGE plpgsql;

CREATE TRIGGER after_insert_trigger
AFTER INSERT ON tx_out
FOR EACH ROW
EXECUTE FUNCTION trigger_function();

Based on the provided information, it seems that the issue has been addressed. We're closing this issue now. If you have any more concerns or if the problem reappears, please let us know by reopening this issue. We appreciate your help!


Add Keimeno TUI engine

I have no idea if the project is mature enough to warrant being on here. I use this library for a handful of my own utilities and it's been great. I don't have tests written for it. I just think it'd be good to get some other eyes on it.
I also don't know if it should be in CLI Builders or CLI Utilities. The list of builders is essentially just option parsers, but utilities are ... applications which run in the console.
Link

Checklist

[x] - Shard is at least 30 days old.
[x] - Shard has CI implemented.
[x] - Shard has daily/weekly periodic builds (ideally with Crystal latest and nightly).

@robacarp Will need the order updated for CI to pass then can :shipit:


ROX-11633, ROX-11634, ROX-11635: Changing Top Riskiest Images/Nodes widget in VM to Top Riskiest Image/Node Vulns

Description
I changed:

Top Riskiest Images widget query to use the imageVulnerabilityCounter

Top Riskiest Nodes widget query to use the 'nodeVulnerabilityCounter`

added Top Riskiest Image Components to the widget behind a feature flag

added links from said widget to the image component page
added links from said widget to the image component/image cves page
added Top Riskiest Node Components to the widget behind a feature flag

added links from said widget to the node component page
added links from said widget to the node component/node cves page

Checklist

[ ] Investigated and inspected CI test results
[ ] Unit test and regression tests added
[ ] Evaluated and added CHANGELOG entry if required
[ ] Determined and documented upgrade steps
[ ] Documented user facing changes (create PR based on openshift/openshift-docs and merge into rhacs-docs)

If any of these don't apply, please comment below.
Testing Performed
TODO(replace-me)
Use this space to explain how you tested your PR, or, if you didn't test it, why
you did not do so. Valid reasons include, for example, "CI is sufficient",
"No testable changes". Feel free to attach JSON snippets, curl commands,
screenshots.
In addition to reviewing your code, reviewers must also review your testing
instructions and make sure they are sufficient.

/retest


Add support "view transaction explorer" for the some chain

Describe the task
Add support "view transaction explorer" for the some chain

Update for chain:

Rococo
Shibuya EVM
Aventus Polkadot
Aventus Testnet
Bobabase

Version test: https://file.cdmteck.com/s/4oimk9zDJ8R5Aai/download?path=%2F&files=./upgrade-ui-pr-1390-build-1.0.5-2-2023-05-20T03-26-53UTC.zip
Validation passed!


AQL Query Slow on Pagination on large result set

Hello,
I was executing the below query.
 FOR manager IN managers FILTER manager.RTB_MANAGER_USR_KEY == 191
 FOR connectedToManager IN 1..1 INBOUND manager._id GRAPH 'graph'
   FOR v,e,p IN 1..4 OUTBOUND connectedToManager._id userToUserGroups,userGroupsToAppInstances,appInstancesToHost,hasAccounts
      FILTER p.edges[3].type == 'hostsToAccounts'
        FOR v1 IN INBOUND v._id userToAccountAsOwner
          FILTER v1.CITY == 'london'
          LIMIT 0, 50
        RETURN v1

These are the response times for various pagination values.
Description                                   Response Time(ms)
1   Return first 50 records                                36 ms
2   Return 50 records after 50 records                 305 ms
3   Return 50 records after 100 records        319 ms
4   Return 50 records after 1000 records          1158 ms
5   Return 50 records after 10000 records         8533 ms
So you can clearly see the response times degrading when I change the pagination limits.
Is there a way to avoid this?
Also I noted that, if I query a record which is present at the end of a large result set, the response times are really bad.
Regards,
Sajeev

Well, this is not eactly unexpected.
LIMIT does a hard abort on the query once the output volume of documents is reached.
If you have a look at the explanation of what the traverser actually does: https://docs.arangodb.com/2.8/Aql/GraphTraversals.html  - its clear that that these steps come for a cost. Each step of the traverser requires index lookups fetching of the data etc.
Another thing is, that v, e and p have to be built up in memory. In your case 3.0 will be able to skip the instanciation of e which will save resources. Maybe in the 3.x release cycle ArangoDB will also become able to find out that your filter was merged into the traverser, and it actualy doesn't have to build up the path - which is even more expensive since it contains all documents on the way.
Maybe depending on the effectiveness of FILTER v1.CITY == 'london' (indexeability, small result set) it could be cheaper to do this step with a join
A resulting join could look like this:
LET allUserKeys = (FOR manager IN managers FILTER manager.RTB_MANAGER_USR_KEY == 191
     FOR connectedToManager IN 1..1 INBOUND manager._id GRAPH 'graph'
       FOR v,e,p IN 1..4 OUTBOUND connectedToManager._id userToUserGroups,userGroupsToAppInstances,appInstancesToHost,hasAccounts
          FILTER p.edges[3].type == 'hostsToAccounts'
       RETURN v1._key)
FOR userKey in allUserKeys
  FOR user IN users
    FILTER user.CITY == 'london' AND user._key == userKey
    RETURN user

You should use db._explain() to check whether parts of the queries will be able to utilize indexes and / or create them for these queries.

Hello,
I tried the AQL query that you suggested. Now the performance is very bad than the original query. The query execution is not getting finished. Please suggest a way ahead.
Regards,
Sajeev

Hello,
Please suggest if there is a way forward.
Regards,
Sajeev

wondering if this has been resolved and what was the work around.


🚀 Feature: Add metadata to DTS generation

Describe the solution
When wrangler types is ran we will want to determine what the user defined name is for metadata then provide the interface for metadata so that the user gets full TypeScript support on that value during development.

Direction changed.


Implement superfast 'load-ahead' scheme by using BC1/3 cached versions that 'click in' to the full quality versions when thay are loaded. This should make is super-responsive when browsing folders with lots of large jpegs or whatever.

Maybe should us BC7 instead of 3. I think there's probably ubiquitous support these days.


Single instance of activity in android

when you share a text or image when the app is in background  the app reopened again and create an new instance of the activity , i know that because i set android:launchMode="singleTop"  but when i switch to android:launchMode="singleTask" one instance is creating but not able to navigate back to previous  screen .Kind regards

have same issues which will lead to memory linkage and it will affect smaller device which leads to app not responding


does it support centos 7

rt

It supports centos7. You can download the releases from https://github.com/neo-project/neo-cli/releases


MAINT: _lib/ccallback: remove unused code

LowLevelCallable never contains a Python callable, so no need to check
for it in the C code.

pypy3 failure unrelated (spurious)

Merged, thanks Pauli


Callback functions not invoked for failed JSONP API requests

The problem that I'm having is that when a JSONP request fails, YOURLS is setting the HTTP status code accordingly. Unfortunately, most browsers will not bother evaluating and processing JavaScript within the response body of a resource that failed to load, which makes sense really.
I think that it would be best that the API simply always returned HTTP status code 200 for all JSONP requests. Then it's the responsibility of the consumer to check the response for the errorCode etc.

So, regular HTTP error codes for standard API requests, but 200 OK for all JSONP? Yes indeed. Makes sense.

@neocotic No, it's absolutely not standard. If a server fail, it should answer with a 5xx, not with a 200 even for JSONP.
Your implementation should manage HTTP failures before parsing answer.
I'm also tempted to say that JSONP is about to dead (in general), as a tricky way to bypass policies.


display lag while modifying selection

Currently, dragging and modifying a selection causes a perceptible display lag. This shouldn't happen. It might be simply that the calculation of deltas when sending updates hasn't been particularly optimized, and we're just invalidating big swathes of the line cache? If not then this is something to improve.

Is this from after a build with https://github.com/google/xi-mac/commit/838bb31cecb0ca8d23a4208ed36d8fe21a43b233?

yea, there's still a perceptible display lag when dragging. Although after building for release it's much better. Which is definitely the benchmark. But if we're laggy even in debug we're doing something wrong somewhere.
But there's lots we can do around drawing performance that's been discussed elsewhere, I'll close this.


Is it possible to create a webrtc application without browser using Openwebrtc

Hi all,
We have an embedded device which has a camera. we need to stream the media from the device to a browser (firefox or chrome). The device doesnot have a browser. We need to create a webrtc application which can run without browser and it should be able to send webrtc streams without browser. Whether we can use OpenWebRTC for creating webrtc applications without browser? We have a signaling server also in middle, for initial connection. The device is linux based.
Thanks in advance.
Suganthi

Yes, that is quite possible.

Does your device have GStreamer elements for camera / microphone?
Here is an example audio/video send/receive WebRTC client that runs from the command line and does not use a browser: https://github.com/EricssonResearch/openwebrtc/blob/master/tests/test_client.c
That test_client.c is written to be compatible with the signalling used on http://demo.openwebrtc.io/ and that page is running use a nodejs server whose code is here: https://github.com/EricssonResearch/openwebrtc-examples/tree/master/web

Thanks for your response.
We have the camera seperate and we are receiving the camera streams via Wifi and planning to use gstreamer.
The signaling server is websocket based. Whether we can use the test_client.c application for communicating with the web scoket based signaling server, or can we modify for working with a websocket based application?

The test client uses the libsoup HTTP library which supports WebSockets so that part should be doable.
You can either modify OpenWebRTC to add code to receive your camera streams from wifi or you can use libopenwebrtc-gst, though the usability of that is quite immature. You would need to enable building of that part of OpenWebRTC through the configure script options. Then you could create a custom gst media source and set your GStreamer bin that is receiving the camera streams onto it. Note that the output of the bin would need to be uncompressed data currently.
What do you get from your camera streams?

We are receving as rtp streams from the camera, which is H.264 encoded.  Thanks.

We have implemented an application by having the test_client.c application as a base.
When executing, it is showing error as follows.
"owrsession owr_session.c:635:_owr_session_emit_ice_state_changed:OwrMediaSession@0x15870f0 Session 1, ICE failed to establish a connection!
ICE state changed from disconnected to failed"
It would be great if someone gives suggestion for resolving the issue.
Thanks.

What networks are you devices on? Are you behind any firewalls?

We are behind our local network and trying to connect to other network. How to resolve the firewall issue?

Are you using a STUN server?

Yes. We are using the default "stun.services.mozilla.com:3478" for our purpose.

I think we were using that on http://demo.openwebrtc.io/ but it proved to be not so stable, similarly we had issues with Google's STUN server so we switched to our own STUN server. Try with these: https://github.com/EricssonResearch/openwebrtc-examples/blob/master/web/client/main.js#L29

u meant "mmt-stun.verkstad.net"? Can you give the port numbers also?

3478 is the standard STUN port.

ok. Thank you so much.

Hi,
We need to use the the media streams via gstreamer instead of capturing from the webcam of my mahcine itself. For using the media streams from gstreamer and use that in openwebrtc, we came to know that we need to enable the --enable-owr-gst=yes in the config file.
How to find whethet the flag "--enable-owr-gst" is already enabled. If it is not enabled, how to enable it.
Thanks.

The GStreamer parts are disabled by default. You will need to enable them in the build, but know that they are not so mature so you may need to report bugs and/or fix things. You can do that in your cerbero clone by editing recipes/openwebrtc.recipe and adding --enable-owr-gst to the configure flags at the beginning of prepare(): https://github.com/EricssonResearch/cerbero/blob/master/recipes/openwebrtc.recipe#L76
For example, you could add the following line at the beginning of that function:
        self.configure_options += ' --enable-owr-gst '

Thank you.

Whether the openwebrtc stack supports only raw data and sending it to the cloud in webrtc camptible format?

Whether it is possible to recevie the RTP streams(in any encoding format H.264, MPEG ) from any other source via wiFi and sending it to the cloud in webrtc format?

Also is there any sample code that was done for adding any source element to custom openwebRTC source os is there any guidelines available for the same.

OpenWebRTC can take raw uncompressed audio and video data when using the custom GStreamer sources. It can always be used to send WebRTC compatible data to another end point, whether that is a cloud service or another client.

Yes, using the custom GStreamer sources.

https://github.com/EricssonResearch/openwebrtc/blob/master/tests/test_gst_io.c

Hi,
Thanks for the response.
Still there some confusions.
Whether the custom GStreamer sources can be used for receiving ONLY RAW media data OR it is possible to receive a COMPRESSED MEDIA DATA?
Thanks in advance.

Your custom GStreamer source would currently have to decompress the media. See https://github.com/EricssonResearch/openwebrtc/issues/224

Thank you.
Currently I am using the test_gst_io.c sample application for understanding the usage of setting the custom sources in openwebrtc.
I made the following changse in test_gst_io.c
#define CUSTOM_VIDEO_SOURCE "udpsrc port=5000 ! application/x-rtp ! rtph264depay ! h264parse ! avdec_h264 ! video/x-raw,width=640,height=480 ! autovideosink"
And, when executing the app, I am getting the following error.
Error parsing 'udpsrc port=5000 ! application/x-rtp ! rtph264depay ! h264parse ! avdec_h264 ! video/x-raw,width=640,height=480 ! videoscale' : no element " avdec_h264"
But when I run the above command with gst-launch with the following command, we are not getting error for avdec_h264 element.
"gst-launch-1.0 udpsrc port=5000 ! application/x-rtp ! rtph264depay ! h264parse ! avdec_h264 ! autovideosink"
We are ab

We don't build gst-libav as part of OpenWebRTC. If you wish to do that then you will need to modify the OpenWebRTC cerbero fork appropriately.
Alternatively, we do build OpenH264 and openh264dec. Try replacing avdec_h264 with openh264dec.

Thank you so much.
Now that error got resolved.
#define CUSTOM_VIDEO_SINK "autovideosink"
#define CUSTOM_VIDEO_SOURCE "udpsrc port=5000 ! application/x-rtp ! rtph264depay ! h264parse ! openh264dec ! capsfilter caps="video/x-raw, width=(int)1280, height=(int)720" ! videoscale"
Now getting error as follows.
(lt-test-gst-io:7605): GLib-GObject-WARNING **: g_object_set_valist: object class 'GstBin' has no property named 'enable-last-sample'
==== Error message start ====
Error in element udpsrc0.
Error: Internal data flow error.
Debugging info: gstbasesrc.c(2943): gst_base_src_loop (): /GstPipeline:media-renderer-1/GstBin:bin2/GstUDPSrc:udpsrc0:
streaming task paused, reason not-negotiated (-4)
==== Error message stop ====

Run with GST_DEBUG=6 set in your environment variables, output the log to file, compress it (zip, gzip, bzip2, xz, whatever is fine) and upload it somewhere then link it here.

Thanks. Sure, I will upload the details. Before that I have a general question.
Whether the openwebrtc0.3.0 has support for handling the gst with "udpsrc" in CUSTOM SOURCE without any modification in the openwebrtc stack?
Thanks.

I can't guarantee it but I think it should. You would have to build it yourself as you have done. But it should work.

Hi,
The modification in test_gst_io.c file is as below:
#define CUSTOM_VIDEO_SINK "autovideosink"
#define CUSTOM_VIDEO_SOURCE "udpsrc port=5000 ! application/x-rtp !
rtph264depay ! h264parse ! openh264dec ! capsfilter caps="video/x-raw,
width=(int)1280, height=(int)720" ! videoscale"
No other changes in the sample file.
The logs that we got is attached with this mail.
Please find the attached log file.
Thanks.
On Wed, Jul 1, 2015 at 10:03 AM, Robert Swain<EMAIL_ADDRESS>wrote:

I can't guarantee it but I think it should. You would have to build it
yourself as you have done. But it should work.
—
Reply to this email directly or view it on GitHub
https://github.com/EricssonResearch/openwebrtc/issues/403#issuecomment-117432172
.

I don't think attachments work with GitHub. Can you email me privately at<EMAIL_ADDRESS>

We have sent the log file to the given mail id. Thanks.

I see that the H.264 bitstream is identified as H.264 High Profile. OpenH264 does not support High Profile. Is it possible to adjust the settings on your network camera to Constrained Baseline Profile? If not, you will have to look into adding some other H.264 decoder to your build, though that could be as simple as adding gst-libav-1.0 to the dependencies of recipes/openwebrtc.recipe in cerbero.

configure: Requested 'gstreamer-1.0 >= <IP_ADDRESS>' but version of GStreamer is <IP_ADDRESS>
I added it inside the openwenrtc.receipe dependency.
I am getting following error when building.
configure: error: no gstreamer-1.0 >= <IP_ADDRESS> (GStreamer) found
Running command 'sh ./autogen.sh --noconfigure && ./configure --prefix /opt/openwebrtc-0.3 --libdir /opt/openwebrtc-0.3/lib --enable-lgpl --disable-examples  --disable-maintainer-mode  --disable-silent-rules  --enable-introspection  --disable-maintainer-mode  --disable-silent-rules  --enable-introspection '
***** Error running 'package' command:
Recipe 'gst-libav-1.0' failed at the build step 'configure'

Hi,
Now we are able use the avdec_h264 plugin and the test_gst_io.c application is able to show the video which is received from another machine via udp.
We used the following in the sample application
#define CUSTOM_VIDEO_SOURCE "udpsrc port=5000 ! application/x-rtp ! rtph264depay ! h264parse ! avdec_h264 ! capsfilter caps="video/x-raw, format=(string)I420, width=(int)640, height=(int)480, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, framerate=(fraction)30/1" ! videoscale"
Is it possible to use this custom source in the test_client application instead of local sources?
It would be helpful if you suggest on this.
Thank you.

You will need to modify the test_client.c code to use the custom media source as it is done in test_gst_io.c

Ok, Thank you Robert.

Hi,
How to stop the gst custom media source transfer in our native webrtc application.
If we need to quit the media transfer, what would be best way to quit it?
Thanks.

Where the source was being used, call set source or set send source with NULL as the source argument. Then unref it with g_object_unref.

You may have to do some manual cleanup of the GStreamer elements after. I'm not sure without looking at the code.

#define CUSTOM_AUDIO_SOURCE "udpsrc port=5001 caps="application/x-rtp" ! rtppcmadepay ! alawdec"
audio_src = get_custom_media_source(OWR_MEDIA_TYPE_AUDIO, CUSTOM_AUDIO_SOURCE);
And the media session part creation part is similar to the test client application.

Hi,
Whether the openWebrtc depends on "libgstdtls and libgstinter?".
Do we need these gst plugin elements?
Please give your suggestion on this.
Thanks.

Yes, it does.

Ok. Thank you.

Hi Robert,
We are currently installing the openwebrtc using cerbero building system in debian linux. but we are getting the following error.
Previously we installed in ubuntu linux and we did not face any issue. Can you please suggest on the below issue?
Thanks a lot in advance.
=========================================================================
Running command 'dpkg-buildpackage -rfakeroot -us -uc -D -b'
dpkg-buildpackage: source package openwebrtc-gstreamer-1.0-core
dpkg-buildpackage: source version 1.5.2-1
dpkg-buildpackage: source distribution unstable
dpkg-buildpackage: source changed by OpenWebRTC<EMAIL_ADDRESS>dpkg-buildpackage: host architecture amd64
dpkg-source --before-build openwebrtc-gstreamer-1.0-core-1.5.2
fakeroot debian/rules clean
dh_testdir
dh_testroot
rm -f build-stamp
dh_clean
debian/rules build
dh_testdir
touch build-stamp
fakeroot debian/rules binary
dh_testdir
dh_testroot
dh_prep
dh_installdirs
dh_installdocs
dh_install
dh_testdir -a
dh_testroot -a
dh_strip -a --dbg-package=openwebrtc-gstreamer-1.0-core-dbg
dh_link -a
dh_compress -a
dh_fixperms -a
dh_makeshlibs -a -V
dh_installdeb -a
dh_shlibdeps -a
dpkg-shlibdeps: error: no dependency information found for /opt/openwebrtc-0.3/lib/libjpeg.so.8 (used by debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstopengl.so)
dh_shlibdeps: dpkg-shlibdeps -Tdebian/openwebrtc-gstreamer-1.0-core.substvars debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/bin/gst-typefind-1.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/bin/gst-launch-1.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/bin/gst-play-1.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/bin/gst-discoverer-1.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/bin/gst-device-monitor-1.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/bin/gst-inspect-1.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/libexec/gstreamer-1.0/gst-plugin-scanner debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstfft-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstudp.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstvolume.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstmulaw.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstrtp.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstrtpmanager.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstpulse.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstopengl.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstvpx.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstvideorate.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstgtksink.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstaudiorate.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstsrtp.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstaudioconvert.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstvideoparsersbad.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstvideo4linux2.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstopus.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstaudiotestsrc.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstvideocrop.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstalaw.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstopenh264.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstvideoscale.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstnice.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstvideofilter.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstvideoconvert.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstdtls.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstaudioresample.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgsttypefindfunctions.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstapp.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstcoreelements.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstinter.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstvideotestsrc.so debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstcontroller-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstcodecparsers-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstcheck-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstnet-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libvpx.so.2.0.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstriff-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstsdp-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libsrtp.so.1 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstgl-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstapp-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libnice.so.10.6.2 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libopus.so.0.5.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstpbutils-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libopenh264.so.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstbadvideo-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstvideo-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstbase-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstbadbase-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstaudio-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstrtp-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstreamer-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgsttag-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstallocators-1.0.so.0.502.0 debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/libgstrtsp-1.0.so.0.502.0 returned exit code 2
make: *** [binary-arch] Error 2
dpkg-buildpackage: error: fakeroot debian/rules binary gave error exit status 2
Traceback (most recent call last):
File "./cerbero/main.py", line 105, in run_command
res = commands.run(command, self.config, self.args)
File "./cerbero/commands/init.py", line 78, in run
return commands[command].run(config, args)
File "./cerbero/commands/package.py", line 97, in run
args.force, args.keep_temp)
File "./cerbero/packages/linux.py", line 57, in pack
self.pack_deps(output_dir, tmpdir, force)
File "./cerbero/packages/linux.py", line 115, in pack_deps
packager.pack(output_dir, self.devel, force, True, True, tmpdir)
File "./cerbero/packages/linux.py", line 78, in pack
paths = self.build(output_dir, tarname, tmpdir, packagedir, srcdir)
File "./cerbero/packages/debian.py", line 282, in build
shell.call('dpkg-buildpackage -rfakeroot -us -uc -D -b', srcdir)
File "./cerbero/utils/shell.py", line 157, in call
raise FatalError(("Error running command: %s") % cmd)
FatalError: Fatal Error: Error running command: dpkg-buildpackage -rfakeroot -us -uc -D -b
***** Error running 'package' command:
Fatal Error: Error running command: dpkg-buildpackage -rfakeroot -us -uc -D -b
usage: cerbero-uninstalled [-h] [-c CONFIG]
{add-recipe,rdeps,tag,genxcconfig,genlibfiles,check,list-packages,build,add-package,show-config,genvsprops,shell,run,cleanone,packageinfo,buildone,wipe,debug-packages,package,bootstrap,list,checkpackage,deps,gensdkshell.
Thanks.

`dpkg-shlibdeps: error: no dependency information found for /opt/openwebrtc-0.3/lib/libjpeg.so.8 (used by debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstopengl.so)``
That is the error line. Does it happen every time? Do you have libjpeg.so.8 somewhere in /opt/openwebrtc-0.3/ ?

No. We tried once. We have this library libjpeg.so.8 in /opt/openwebrtc-0.3/.
We tried to run the application and it is working fine.
But we got the error at the last stage of the cerbero build.

Hi Robert,
We have a question when using the local media sources.
We have a webcam connected to our system. If the video source is coming as H264 encoded format from the webcam, whether the openwebrtc is able to handle the compressed (H264) video and audio(AAC) sources.
Can you please confirm about this?
Thanks.

Now that issue #240 is almost addressed, it should be possible to support compressed sources soon. Maybe hop onto IRC and talk to slomo (@sdroege)

Thank you so much.
Currently we are using the openwebrtc-0.3 version. In that, if v4l2src is used for capturing the local video source, whether it will be taken as video/x-raw or it is able to use as video/x-h264 in case of compressed video input from webcam?
If reading compressed video is currently not supported, then you are telling that the new openwebrtc stack will be released soon for reading the compressed video (H264)? My understanding is correct?

0.3 will use video/x-raw.
Issue #224 is the one to track for compressed source support.

ok, Thank you.

Hi Robert,
Do you have any suggestion on how to send the audio and video in sync from the openwebrtc application?
Thanks.

Hi,
In the libvpx library, we have enabled the CONFIG_REALTIME_ONLY and  CONFIG_ONTHEFLY_BITPACKING. Now when we are using gst-launch command for sending the video from device to another machine, there is no delay now. But still, a delay of 4s is there in the openwebrtc application. What might be affecting the delay. we played around with the vp8 encoding also.
What else may create this delay of 4s.
It would be of great help.

Then how to output the remote source into a udp stream (udp://xxxxxxx) rather than rendering on a browser?

And when I do ./configure, always got the following error:
checking for GSTREAMER_SCTP... no
configure: error: Package requirements (gstreamer-sctp-1.0) were not met:
No package 'gstreamer-sctp-1.0' found
Consider adjusting the PKG_CONFIG_PATH environment variable if you
installed software in a non-standard prefix.
Alternatively, you may set the environment variables GSTREAMER_SCTP_CFLAGS
and GSTREAMER_SCTP_LIBS to avoid the need to call pkg-config.
See the pkg-config man page for more details.

Hi,
I got the same problem :
...
dpkg-shlibdeps: error: no dependency information found for /opt/openwebrtc-0.3/lib/libjpeg.so.8 (used by debian/openwebrtc-gstreamer-1.0-core/opt/openwebrtc-0.3/lib/gstreamer-1.0/libgstopengl.so)
...
I have already check the path : " /opt/openwebrtc-0.3/lib/libjpeg.so.8" is exist.
But I dont know why it got error.....
Does anyone know how to fix it ?

This should now be fixed if you update your cerbero clone. A couple of packaging dependencies were missing.

Thanks for reply
Do you recommand to build on Ubuntu 12.04 ? Or 14.04 ?
Or anyother platform?

14.04.

Hi,
When I use iOS client to initiate a SDP session, the message is like:
{"type": "offer", "sdp": "v=xxxxx,xxx"}
But the test_client.c under "tests" expects the message like {"sdp": {"type":"offer", "sdp":"v=xxx,xxx"}, "sessionDescription":{"version":0,"originator":{"username":"-","sessionId":1442570332604854000,"sessionVersion":1,"netType":"IN","addressType":"IP4","address":"<IP_ADDRESS>"},"sessionName":"-", .....}
What's wrong, how can I generate the missing part of the SDP "offer" message?
Thanks!

@barcoyou You can experiment by changing what is signaled here: https://github.com/EricssonResearch/openwebrtc-examples/blob/master/ios/NativeDemo/NativeDemo/NativeDemoViewController.m#L185

@suganthikarthick  Did you make it work? I want to do the same like you are doing. Thanks


CLB: blank sector in the report on ITIS sectors - it's not flagged as a broken

CLB on PROD
Frontend version: 1bb80f5 February 11, 2022 1:19 PMBackend version: c94dbef February 15, 2022 12:00 AM
@mdoering, @thomasstjerne
There is a strange case of blank sector in ITIS. It looks like that:

There are no broken sectors in ITIS according to the report.
My attempt to re-match blank sector in Coleoptera failed and pop-up menu reported "broken sector". However, the sector is not flagged as "broken" in the report on ITIS sectors.
(Now ITIS report is down completely, see https://github.com/CatalogueOfLife/checklistbank/issues/1007)

duplicate of https://github.com/CatalogueOfLife/checklistbank/issues/1007


Breaking Change in FileMatcher: ab*ba pattern matches aba by mistake

Performance optimization #2392 led to a breaking change in FileMatcher logic. Please see suggested fix in my pull request #2814.
Steps to reproduce
Let's examine the following project with a single web.config file in working directory:
<Project ToolsVersion="12.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003" DefaultTarget="PublishFiles">
  <Target Name="PublishFiles">
    <ItemGroup>
      <DistributionFiles Include="**\*" Exclude="web.*.config">
      </DistributionFiles>
    </ItemGroup>
    <Message Text="@(DistributionFiles)" />
  </Target>
</Project>

Expected  behavior
We should see web.config in the output
Actual behavior
We don't see web.config in the output

Fixed in #2814


Download photos provided through the API

Sets up a post-processing task for records that come through the API, to download and store the photos if photo_url is specified.
Since that eliminates the last reason we'd serve a third-party photo URL, also eliminates the code to do that and always serves our own photo URLs. Note that we're still storing third-party URLs so we could pass them on to other partners via the API.
Two messages are getting eliminated from the django.po files: one is the warning for zero-rating repos when showing a third-party image (no longer applies), and one is a street name label (which should have already gotten dropped in #568).

Scratch all this. We talked this over in the PF meeting tonight and there's been a change of plans for how to handle these images.


responses does not work as expected due to passthru rule

Hey,
I just ran into an issue while using responses and moto at the same time.
If you use @responses.activate, you would expect that all HTTP requests are blocked and an exception is raised when you request an URL which has not been specified using responses.add. This works well as long as you are not importing moto. As soon as you import moto, it runs responses.add_passthru("http") and basically whitelists "all" HTTP requests and no exception is raised anymore. So if you have a typo in your URL (be it the host or a (missing) query parameter or ...), the original request is not blocked and hits the real server. This behavior is illustrated here:
import responses
import requests
import pytest
from requests.exceptions import HTTPError

import moto  # adds passthru rule

def my_func():
  response = requests.get('https://google.com')  # will hit the host
  response.raise_for_status()
  ...

@responses.activate
def test_simple():
    responses.add(responses.GET, 'https://gogle.com',  # there's a typo
                  json={'error': 'not found'}, status=404)

    with pytest.raises(HTTPError):  # and no error is raised
        my_func()

This behavior was introduce in https://github.com/spulec/moto/issues/1567 / https://github.com/spulec/moto/commit/aa896a0c2e001cbb99b8981e30809925e701f433#diff-c1702816f8e7b12840f59610766977e0R200
I am not sure, how this issue should be fixed. My intuition tells me, that this should not be the default behavior as this issue can kind of only be discovered by looking at the logs. Output of pytest:
--------------------------------------------------------------------------------------------- Captured log call ----------------------------------------------------------------------------------------------
INFO     responses:responses.py:636 request.allowed-passthru

Thanks for raising this @escaped. There's a related issue here: #3264, but no specific solutions for either yet.

Oh... sorry for reporting the issue again; I did not see the other issue for some reason. I'll close this one in favour of #3264 :)


#1378 Replaced WebL10n to i18next in Planets Activity

@llaske pls review the pr
attaching ss of the results
Replaced WebL10n to i18next in Planets Activity

Good. Thanks.


add Ganhuo

Hey @xu6148152 - going to remove this for now.. pls resubmit when app is more complete and update the readme. thx


Looks like 2.72.1 is not published to npm

https://www.npmjs.com/package/request
https://github.com/request/request/releases/tag/v2.72.1

neither is 2.73.1


[BUG] Can't change FPS on OAK-D-Lite

I can't change the FPS on the OAK-D-Lite (but I can on OAK-D).
I used the code from here and i added the highlighed lines:
#!/usr/bin/env python3

import cv2
import depthai as dai

# Create pipeline
pipeline = dai.Pipeline()

# Define source and output
camRgb = pipeline.create(dai.node.ColorCamera)
xoutRgb = pipeline.create(dai.node.XLinkOut)

xoutRgb.setStreamName("rgb")

# Properties
camRgb.setPreviewSize(300, 300)
camRgb.setInterleaved(False)
camRgb.setColorOrder(dai.ColorCameraProperties.ColorOrder.RGB)

# -------------------- ADDED LINES --------------------
print(f"FPS before: {camRgb.getFps()}")
camRgb.setFps(60)
print(f"FPS after: {camRgb.getFps()}")
# -----------------------------------------------------

# Linking
camRgb.preview.link(xoutRgb.input)

# Connect to device and start pipeline
with dai.Device(pipeline) as device:

    print("Connected cameras: ", device.getConnectedCameras())
    # Print out usb speed
    print("Usb speed: ", device.getUsbSpeed().name)

    # Output queue will be used to get the rgb frames from the output defined above
    qRgb = device.getOutputQueue(name="rgb", maxSize=4, blocking=False)

    while True:
        inRgb = qRgb.get()  # blocking call, will wait until a new data has arrived

        # Retrieve 'bgr' (opencv format) frame
        cv2.imshow("rgb", inRgb.getCvFrame())

        if cv2.waitKey(1) == ord("q"):
            break

I tested the same code with OAK-D and OAK-D-Lite. After setting the new value for fps, the output of camRgb.getFps() is the same for both the devices, but only the OAK-D actually changes the fps, whereas the OAK-D-Lite doesn't change the fps.

Sorry about the trouble.  Yes, I think OAK-D-Lite FPS is locked right now as a result of an underlying implementation bug or lacking.
Will circle back.

This is not implemented yet, but work in progress (RGB only for now) on the branch cfg_fps_lite (current commit).
IMX214 is capable of 1080p@60fps, but at the moment the camera configs we use are limiting the FPS to:

0.735 .. 35 for 1080p
1.4 .. 28.5 (TODO why not 30) for 4K/12MP/13MP

Also note here the pipeline is just statically configured on the host system, there is no interaction with the device and the device type is not known:
print(f"FPS before: {camRgb.getFps()}")
camRgb.setFps(60)
print(f"FPS after: {camRgb.getFps()}")

Only at this point it reaches the device: with dai.Device(pipeline) as device:
and warnings should be printed on OAK-D Lite that FPS change is not implemented (note the warning wasn't removed yet on the branch cfg_fps_lite).

Is there a schedule for this to be supported officially? Would be really nice having color and depth @ 60fps

35 FPS seems to work for color on OAK-D Lite with new release 2.15.0 https://github.com/luxonis/depthai-python/releases/tag/v<IP_ADDRESS> :+1:  However, mono is is still not implemented.

@JojoDevel We should get configurable and higher FPS for OV7251 mono (at least 60 fps) in about 2 weeks.
Then need to look on getting better configs for IMX214 color to achieve 60fps at 1080p.
For OV7251, 200 FPS will also be supported (was tested experimentally), but we need some more work on lowering the 3A calculation rate (every N frames) at this high FPS.

That sounds amazing :rocket: Looking very much forward to that :+1:

@alex-luxonis Any news on higher framerates?

@alex-luxonis any progress on the fps?

@JojoDevel Apologies for the delay, it's implemented now on https://github.com/luxonis/depthai-python/pull/566

For IMX214, the camera configs still have the FPS limitations mentioned in the comment above: https://github.com/luxonis/depthai/issues/624#issuecomment-1026029818

Will ever be possible to have more fps on IMX214M?

Hi, I got the same issue on OAK-D Lite after I ran the examples/Yolo/tiny_yolo.py
[1844301041180E1300] [20.1] [398.391] [system] [warning] ColorCamera IMX214: capping FPS for selected resolution to 35
The first time I ran the examples/ColorCamera/rgb_preview.py it approached 60 FPS and no warning came out.
Then I ran the  examples/Yolo/tiny_yolo.py and the warning came out
After that, I ran the examples/ColorCamera/rgb_preview.py again and the warning was still there and FPS can't be up to 60

@li195111 how did you calculate the FPS it approached?

@brentonjackson I use count / time.monotonic()

@BiomechatronicsRookie

Hi all. I understand then that the OAK D Lite cannot be set to 60 fps for the RGB camera then?

Correct - for RGB, 35FPS is the limit - for the time being