Support for routing cross-origin OPTIONS requests

It seems that it's currently not possible to route cross-origin OPTIONS requests with Spring Cloud Gateway to other backend services. This would be desirable so that the components serving the requests can decide on their own which CORS headers to return to their clients. As far as I know it's currently only possible to handle CORS within the gateway itself via a global configuration.
I've created a pull request in my forked repository that adds a failing test to the spring-cloud-gateway-sample application.
There's already been a discussion on the topic in #229 starting with this comment.

Closing in favor of #840 that has a link to a PR

I don't think that the PR for #840 accomplishes what this issue asks for. If I understand the PR correctly, it adds an option to apply the global configuration for requests that are not routed by the gateway. This feature request is about adding support for routing preflight requests to other backend services.
@tony-clarke-amdocs May I ask you to confirm this?

Thanks for the clarification.

PRs welcome

+1

+1

Please stop commenting +1 and just add a thumbs up on the original comment

Faced this issue when tried to pass preflight request through API gateway.
The core of issue is AbstractHandlerMapping from webflux.
I just briefly observed webflux sources and still not so familiar with ideology but from the first look webflux processes OPTIONS (and looking deeper - preflights) in very specific way.
For me fix looks like the following:
public class GatewayCustomConfiguration extends GatewayAutoConfiguration {

    @Bean
    public RoutePredicateHandlerMapping routePredicateHandlerMapping(FilteringWebHandler webHandler,
                 RouteLocator routeLocator, GlobalCorsProperties globalCorsProperties, Environment environment) {

        return new RoutePredicateHandlerMapping(webHandler, routeLocator, globalCorsProperties, environment){

            public Mono<Object> getHandler(ServerWebExchange exchange) {
                Mono<Object> handler = getHandlerInternal(exchange).map((hndl) -> {return hndl;});
                return CorsUtils.isPreFlightRequest(exchange.getRequest()) ? handler : super.getHandler(exchange);
            }
        };
    }
}

and
spring.cloud.gateway.enabled = false
That works for me as hotfix but I don't like it because I cannot predict all drawbacks.

PRs welcome

@spencergibb Do you have an idea what you expect to be the real functional solution? Is it something as simple as a configuration option that (e.g. spring.cloud.gateway.globalcors.route=true) that does effectively what @A-n-d-r-e-i-P suggested?
I'm trying to understand what the most ideal solution would be that plays well with AbstractHandlerMapping?

Maybe the property name should be something like spring.cloud.gateway.globalcors.preflight.passthrough=true? (I've not looked into how to implement it yet)

Have the same problem. Use SpringBoot webflux and SpringCloud Gateway ,can't forward OPTIONS requests with Spring Cloud Gateway to out backend service.
So I overwite  "org.springframework.web.cors.reactive.CorsUtils" class,
just make isPreFlightRequest always return false , that solved my problem.
 public static boolean isPreFlightRequest(ServerHttpRequest request) {
        //HttpHeaders headers = request.getHeaders();
        //return (request.getMethod() == HttpMethod.OPTIONS
        //        && headers.containsKey(HttpHeaders.ORIGIN)
        //        && headers.containsKey(HttpHeaders.ACCESS_CONTROL_REQUEST_METHOD));
        return false;
    }

@spencergibb, would it be appropriate to override org.springframework.web.cors.reactive.CorsUtils#isPreFlightReuqest as proposed by @superbool and make this configureable with spring.cloud.gateway.globalcors.preflight.passthrough=true?

Have the same problem. Use SpringBoot webflux and SpringCloud Gateway ,can't forward OPTIONS requests with Spring Cloud Gateway to out backend service.
So I overwite "org.springframework.web.cors.reactive.CorsUtils" class,
just make isPreFlightRequest always return false , that solved my problem.
 public static boolean isPreFlightRequest(ServerHttpRequest request) {
        //HttpHeaders headers = request.getHeaders();
        //return (request.getMethod() == HttpMethod.OPTIONS
        //        && headers.containsKey(HttpHeaders.ORIGIN)
        //        && headers.containsKey(HttpHeaders.ACCESS_CONTROL_REQUEST_METHOD));
        return false;
    }

You should consider the other public methods as well to not get a NoSuchMethod Exception occasionally:"
public class CorsUtils {

    public static boolean isCorsRequest(ServerHttpRequest request) {
        return false;
    }

    public static boolean isPreFlightRequest(ServerHttpRequest request) {
        return false;
    }

    public static boolean isSameOrigin(ServerHttpRequest request) {
        return false;
    }
}

@tillmannheigel
I tried this code:
import org.springframework.http.server.reactive.ServerHttpRequest;
import org.springframework.stereotype.Component;
import org.springframework.web.cors.reactive.CorsUtils;

@Component
public class CustomPostGlobalFilter extends CorsUtils {

    public static boolean isCorsRequest(ServerHttpRequest request) {
        return false;
    }

    public static boolean isPreFlightRequest(ServerHttpRequest request) {
        return false;
    }

    public static boolean isSameOrigin(ServerHttpRequest request) {
        return false;
    }
}

But again OPTIONS request is forwarded. Can you advice what is the proper way to implement the quick fix, please?

@tillmannheigel I tried this code:
import org.springframework.http.server.reactive.ServerHttpRequest;
import org.springframework.stereotype.Component;
import org.springframework.web.cors.reactive.CorsUtils;

@Component
public class CustomPostGlobalFilter extends CorsUtils {

    public static boolean isCorsRequest(ServerHttpRequest request) {
        return false;
    }

    public static boolean isPreFlightRequest(ServerHttpRequest request) {
        return false;
    }

    public static boolean isSameOrigin(ServerHttpRequest request) {
        return false;
    }
}

But again OPTIONS request is forwarded. Can you advice what is the proper way to implement the quick fix, please?

Not extends CorsUtils ,but overwite CorsUtils  abstract class.

@superbool Can you show me code example, please?

Corp org.springframework.web.cors.reactive.CorsUtils.java source code to your own project，and overwite
isPreFlightRequest method. It looks like this。

Corp org.springframework.web.cors.reactive.CorsUtils.java source code to your own project，and overwite isPreFlightRequest method. It looks like this。

@rcbandit111

Is there any Update on this?
@superbool Your suggested Solution works! Thank you. ❤
I am searching for a way to tell Spring Reactive to handle Preflight Requests like the any other Request. I faced this Issue when using Spring Cloud Gateway and posting a Request to an API. The Preflight-Request is Rejected with 403. I found many Threads about similar Issues and many people suggest implementing a Cors Filter. But I do not think that the Gateway should worry about CORS. Therefore I would like to pass this Preflight request to the API.

I've been troubled by this problem for a long time.
If we haven't configured the gateway to perform certain tasks, the gateway should be completely transparent.

If there is no config, just return true. But this class org.springframework.web.cors.reactive.DefaultCorsProcessor is in spring-web, not the gateway.


Bump up onnx version

Bump up onnx version to take fix for OCR model

my bad.. forgot to update other script..

Since this fix is important for the OCR team, let's do this for the 0.4 rel branch as well.

A bunch of other scripts need to be updated as well. See this as example.

A bunch of other scripts need to be updated as well. See this as example.

@snn @raymondxyang are other files not required any more to bump up onnx version?

A bunch of other scripts need to be updated as well. See this as example.

@snn @raymondxyang are other files not required any more to bump up onnx version?

Ah, I see a follow up PR for this.


Not working in Dragonflight (API changes)

In Dragonflight, Paragon does not work and throws this error:
25x Interface/AddOns/Paragon/Core.lua:191: attempt to call global 'GetFriendshipReputation' (a nil value)
[string "@Interface/AddOns/Paragon/Core.lua"]:191: in function <Interface/AddOns/Paragon/Core.lua:180>
[string "@Interface/AddOns/Paragon/Core.lua"]:646: in function <Interface/AddOns/Paragon/Core.lua:634>

According to WoWPedia, in Dragonflight GetFriendshipReputation has been replaced with C_GossipInfo.GetFriendshipReputation.
By changing this (Core.lua, line 191), plus a couple of nil checks for non returned barMin values in the same function, I was able to get it to work provisionally. Though, I have not investigated further why no values are returned, can be a Blizz bug or another API change.

Hello tflo, could you please share a link to download the version you have been able to repair ? I really need this addon, thank you !

Here the patched Core.lua file: https://d.pr/f/unj6B2 . Just replace the old one inside the Paragon addon folder.
The C_GossipInfo.GetFriendshipReputation change is essential and correct due to the API changes, however the 3 added nil checks are provisonal hacks, i.e. they just make the addon working, but they do not eliminate the cause of missing min values.
That being said, so far it is working for me, but I'm using it mainly with Legion rep tokens, maybe it freaks out or gives wrong values with other reputations. Double-check the values the addon returns!

Thank you very much, Tflo ! Worked perfectly.

Lol, broken again in 10.0.2. They generously changed the whole tooltip API. Looks like this needs some more work than updating a function name…

OK, here is a working version for 10.0.2. It's the whole addon this time, as I have updated the toc file too. Use with caution!
Paragon - Inofficial and hackish patch for 10.0.2.zip

Thank you Tflo, really appreciated ! Installed and working.

@vince2paname Please try version 2 from above. This should fix the issue with comparison tooltips.

This version works better. I had some lua errors previously. Thanks again.

Sorry I haven't updated the addon much. I've been considering a complete rewrite. I'll try to get a working version out soon.

I have now released a working version for 10.0.2: Chalcedony 3


Improve version control, reporting, and integrity support to enhance security

Is your feature request related to a problem? Please describe.
Elements could be modified between original generation and use without easily being noticed.  A holistic design approach to version control, reporting, integrity should be considered to support the various use cases.
Currently state:

Repo information (git describe in a subset of repos) is gathered during build and reported on execution for top branch, cFE and OSAL- need to expand this to include all the elements (apps, libs, psp, etc)
Build information is gathered during build and reported on execution - user name and date for last full build covering cFE (doesn't cover uploaded apps or elements built separately/after the original full build)
Version information updated by hand and reported at execution time for most of cFS - elf2cfetbl and tblCRCtool don't report version information, hasn't been consistently updated
Checksums are typically just calculated and reported at load/execution, doesn't cover libs, really should employ digital signatures that can be verified

Describe the solution you'd like
See above suggestions
Describe alternatives you've considered
None, but should discuss with security experts and come up with a complete, well vetted solution.
Additional context
Likely very beneficial to community requiring a more robust security approach
Requester Info
Jacob Hageman/NASA-GSFC

@jwilmot - heads up for discussion

This topic also needs to cover the onboard integrity verification (currently CS) and related enhancements.

CCB 20191001 - Brought up topic, will likely depend on funding

@ArielSAdamsNASA this might interest you


use placeholder for table name in add sql bindings quickpick

This PR fixes #17248. This is how it looks now with a placeholder:

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
23 unchanged lines in 1 file lost coverage.
Overall coverage remained the same at 41.673%

Files with Coverage Reduction
New Missed Lines
%

extensions/sql-database-projects/src/dialogs/addSqlBindingQuickpick.ts
23
34.11%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
26706

Relevant Lines:
58050

💛  - Coveralls


/en-US/docs/Web/CSS/scrollbar-width

Request type

[ ] Please close this issue, I accidentally submitted it without adding any details
[ ] New documentation
[x] Correction or update

Accessibility
IMHO this page / property is in serious need of an Accessibility notice. Setting the scrollbar-width to "thin" or "none" makes content hard or impossible to scroll if the author does not provide alternative means of scrolling. While swiping or mouse wheeling over such areas might work, some pentablets have no scroll alternative e.g. "jog shuttles".
On HD screens "thin" is also hard to hit with a mouse cursor.
Thanks.

@WebMechanic I agree with you; what do you think of this:
https://developer.mozilla.org/en-US/docs/Web/CSS/scrollbar-width#Accessibility_concerns
?

Nice one! :) that was quick!
And thank you for adding the guideline links.
There's a typo in "mechnism".
With ragard to Retina/HD screens: "thin" and the recommended 44px (~ 1.12cm?) don't really match up, right? Should this be mentioned near the last sentence about the recommended target size?
I can't tell how thin "thin" appears on Apple devices. They're definitely a tad too slim on Win10 and Android.

Unfortunately there appears to be no browser setting (or general OS feature) to define a minimum scrollbar width or a "prefers-" MQ property.
I personally hate this "design trend" and find thin scrollbars very hard to hit with my pen even on 1dpr screens. On touch screens there's always an issue with the parallax view that turns these tiny scrubbers in a constant hit and miss experience.

Cool, I've fixed the typo and added some additional info advising thorough testing, as the problem coujld be worse on high res screens.
I'd rather not add too much more, as the whole thing tends to get complex and subjective after a while. I'd prefer to leave this up to devs to do their testing properly; at least we are including some info to make them think about it.
Yes, it might be an interesting MQ to have available, but then again this would be adding a very specific feature to the platform to mitigate the harm done by another very specific feature. I think we should have just left it alone in the first place ;-)
Thanks again for your help.

great job @chrisdavidmills ! thank you!

I think we should have just left it alone in the first place ;-)

Fully agree! When IE4+ supported custom scrollbars there where loads of horribly coloured and partially visible bars roaming the web. I remember that at some point early Chrome had some of these proprietary properties too, but it seems like they're gone with Blink -- for good I hope.


Weird BindingException

version：3.5.4
The production operation has been normal. After adding an assistTaskType parameter to the mapper, an error is reported: BindingException
The local operation is normal, and there are two machines in the production environment, one is normal and the other is abnormal. Both machines have the same code
code show as below：
@Mapper
public interface OfflineTaskMapper extends BaseMapper<OfflineTask> {
    List<OfflineTaskAddress> getDistributeTask(String queueCode, Integer assistTaskType, Double minLon, Double maxLon, Double minLat, Double maxLat, Integer count);
}

xml:
    <select id="getDistributeTask" resultType="com.my.pojo.bean.OfflineTaskAddress">
        select tot.*,
               totda.longitude,
               totda.latitude
         from t_offline_task tot
         inner join t_offline_task_distribute_address totda on tot.id = totda.task_id
        where tot.queue_code = #{queueCode}
          and tot.c_uid is null
          and tot.status != 3
          and is_stop = 0
          <if test="assistTaskType != null">
            and tot.assist_task_type = #{assistTaskType}
          </if>
          and totda.longitude between #{minLon} and #{maxLon}
          and totda.latitude between #{minLat} and #{maxLat}
          limit #{count}
    </select>

Wrong one machine prompt:
ognl.MethodFailedException: Method "getDistributeTask" failed for object com.baomidou.mybatisplus.core.override.MybatisMapperProxy@2aea926 [org.mybatis.spring.MyBatisSystemException: nested exception is org.apache.ibatis.binding.BindingException: Parameter 'assistTaskType' not found. Available parameters are [param7, param5, param6, param3, param4, arg6, param1, param2, arg3, arg2, arg5, arg4, arg1, arg0]]
The other machine returns the result correctly
error message：
org.mybatis.spring.MyBatisSystemException: nested exception is org.apache.ibatis.binding.BindingException: Parameter 'assistTaskType' not found. Available parameters are [param7, param5, param6, param3, param4, arg6, param1, param2, arg3, arg2, arg5, arg4, arg1, arg0]
at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:92)
at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440)
at com.sun.proxy.$Proxy166.selectList(Unknown Source)
at org.mybatis.spring.SqlSessionTemplate.selectList(SqlSessionTemplate.java:223)
at com.baomidou.mybatisplus.core.override.MybatisMapperMethod.executeForMany(MybatisMapperMethod.java:177)
at com.baomidou.mybatisplus.core.override.MybatisMapperMethod.execute(MybatisMapperMethod.java:78)
at com.baomidou.mybatisplus.core.override.MybatisMapperProxy.invoke(MybatisMapperProxy.java:96)
at com.sun.proxy.$Proxy172.getDistributeTask(Unknown Source)
at com.my.service.OfflineTaskDbService.getDistributeTask(OfflineTaskDbService.java:386)

Hello @jmilktea ,
You need to compile the project with -parameters compiler option.
See this post for how (it's Japanese, but you'll get the point).

Happened again today and I don't know why

Happened again today and I don't know why
The method mentioned above can be annotated with @Param
What happened today is another method that doesn't have that annotation
I can't explain why one machine works and the other doesn't
I looked at the mapper.class file and it didn't make a difference on the two machines
Will it be a bug when mybatis is running?
@harawata

Please post the outputs of javap -v YourMapper.class for both environment.

I downloaded the class files of the two machines and used javap -v on windows to get their content to be the same, and there is no difference.
And we package it in one place and send it to two machines. The contents of the jar package should be the same. What other possibilities do you think could go wrong.
This method did not go wrong in the last release, but another method went wrong, none of them used @Param
This method is wrong in this release.
-- 1
public abstract com.baomidou.mybatisplus.extension.plugins.pagination.Page<com.al.risk.collection.offline.pojo.bean.OfflineTask> getOfflineTaskList(com.baomidou.mybatisplus.extension.plugins.pagination.Page, com.al.risk.collection.offline.controller.req.QueryTaskReq);
    descriptor: (Lcom/baomidou/mybatisplus/extension/plugins/pagination/Page;Lcom/al/risk/collection/offline/controller/req/QueryTaskReq;)Lcom/baomidou/mybatisplus/extension/plugins/pagination/Page;
    flags: ACC_PUBLIC, ACC_ABSTRACT
    Signature: #79                          // (Lcom/baomidou/mybatisplus/extension/plugins/pagination/Page;Lcom/al/risk/collection/offline/controller/req/QueryTaskReq;)Lcom/baomidou/mybatisplus/extension/plugins/pagination/Page<Lcom/al/risk/collection/offline/pojo/bean/OfflineTask;>;

-- 2
public abstract com.baomidou.mybatisplus.extension.plugins.pagination.Page<com.al.risk.collection.offline.pojo.bean.OfflineTask> getOfflineTaskList(com.baomidou.mybatisplus.extension.plugins.pagination.Page, com.al.risk.collection.offline.controller.req.QueryTaskReq);
    descriptor: (Lcom/baomidou/mybatisplus/extension/plugins/pagination/Page;Lcom/al/risk/collection/offline/controller/req/QueryTaskReq;)Lcom/baomidou/mybatisplus/extension/plugins/pagination/Page;
    flags: ACC_PUBLIC, ACC_ABSTRACT
    Signature: #79                          // (Lcom/baomidou/mybatisplus/extension/plugins/pagination/Page;Lcom/al/risk/collection/offline/controller/req/QueryTaskReq;)Lcom/baomidou/mybatisplus/extension/plugins/pagination/Page<Lcom/al/risk/collection/offline/pojo/bean/OfflineTask;>;

There is no MethodParameters section in the outputs, so as far as I know, the same error should occur on any environment if you are using that binary.
MyBatis cannot reference parameter names that don't exist in the binary, you know.

I'm very surprised that you know this method we've been running for a long time. And there is indeed one machine that is normal. I use the method to call the method on the corresponding machine. It is true that one is wrong and the other is normal. I could not understand.
@harawata

I noticed that the javap -v outputs you posted are for some mybatis-plus class.
You need to specify YOUR mapper class as the argument (the mapper that contains getDistributeTask method).

Thanks for your answer, maybe it's the problem of mybatis plus, I'll take a look
@harawata

@harawata can i provider a pr to fix this question,  don't need @Param annotation later.

@chenshun00 ,
I'm not sure what you mean.
In my understanding, there is nothing to fix.

Sorry, originally I wanted to try to use asm to get the parameters, but the
interface does't contain  the localVariableTable。
Iwao AVE! @.***> 于2022年7月15日周五 12:09写道：

@chenshun00 https://github.com/chenshun00 ,
I'm not sure what you mean.
In my understanding, there is nothing to fix.
—
Reply to this email directly, view it on GitHub
https://github.com/mybatis/mybatis-3/issues/2591#issuecomment-1185152951,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AGGUYIUBQENHLZYJYJV5BS3VUDP7JANCNFSM5ZWKT5EA
.
You are receiving this because you were mentioned.Message ID:
@.***>


Add a generic add/get function [Suggestion]

It would be very nice to have a generic function to get and add info, that would enable to do generic treatment (e.g INPC events) also in a generic way.
An usage example:
Current
public string MySetting
        {
            get => CrossSettings.Current.GetValueOrDefault(nameof(MySetting), "");
            set
            {
                CrossSettings.Current.AddOrUpdateValue(nameof(MySetting), value);
                RaisePropertyChanged(nameof(MySetting)); // this line repeated on every setting
            }
        }

Possible public interface
public string MySetting
{
	get { return GetSetting(nameof(MySetting), ""); }
	set { SetSetting(nameof(MySetting), value); }
}

public void SetSetting<T>(string name, T @default)
{
	if(CrossSettings.Current.AddOrUpdateValue(name, @default))
		 RaisePropertyChanged(name);

}

This was already removed as it can be abused since it doesn't support all data types.

An InvalidArgumentException would put a stop on possible abuses xD


Clarify that MITRE != The CVE Program

MITRE is many things, but it is not the CVE Program, so don't propagate that misconception here.
Why:
MITRE is the CVE Program Secretariat, one of the two CNA Top Level Roots, and the CNA of Last Resort under one of the two CNA Top Level Roots, but it is not the unilaterally the CVE Program. See https://www.cve.org/ProgramOrganization/Structure
Check off the following:

[x] I have reviewed my changes in staging, available via the View deployment link in this PR's timeline (this link will be available after opening the PR).

For content changes, you will also see an automatically generated comment with links directly to pages you've modified. The comment won't appear if your PR only edits files in the data directory.

[x] For content changes, I have completed the self-review checklist.

@andrewpollock Thanks so much for opening a PR! I'll get this triaged for review ✨


Explain permission use of OptMeowt in readme

I think it would increase transparency and understanding if we describe the reasons for using each permission similar to uBlock Origin.

I added some clarification in the readme that we are not collecting any data. Otherwise, this is good.


[BUG] RECI implementation flaw?

I notice that in the current implementation (cdt 0.5.23) of the RECI algorithm there are these two lines (b_fit_score function):
poly_x[:,1] = 0
poly_x[:,2] = 0

which essentially supress the coefficients of x and x^2 in the polynomial. For the default degree of 3, this is basically fitting the function f(x) = a * x^3 + b in both causal directions.
I am pretty sure this is not mentioned in the original paper.
Is it intended for some reason? Please clarify.
Thank you!

Hello,
I will look into it, it seems strange indeed


utils: fix parsing of cgroup with : in the name

a cgroup can have ':' in its name.  Make sure the parser doesn't split
more than 3 fields and leave untouched the ':' in the cgroup name.
commit 6ee5f740a4ecb70636b888e78b02065ee984636c introduced the issue.
Signed-off-by: Giuseppe Scrivano<EMAIL_ADDRESS>

LGTM

/lgtm
/hold

/lgtm

/hold cancel


ASAN failures in various file processing commands

Found via fuzzing. I have a patch that makes it easier to fuzz arguments to toybox commands. I can post it to the mailing list if it sounds generally useful.
heap-buffer-overflow:

toybox sed /[[
echo -ne '\0' | toybox sed hg
echo -e '\n\0aaaaaaa\nx' | toybox grep -B2 x

Segfault:

echo -ne '\x7fELF\00000000000000000000000000000000000000000000' > elf; toybox file elf
echo if > broken.sh; toybox sh -c '. broken.sh'

I'm collecting them here, but I keep having to sign house sale closing paperwork (a notary is coming by on sunday with more) and I'm sort of curled up into a ball at the moment. Bit behind on stuff, sorry...

patch for the file(1) crash sent to the mailing list: http://lists.landley.net/pipermail/toybox-landley.net/2024-August/030481.html


Diffie Helman error

I am getting: : diffie hellman key exchange still under development
Is there any way around this?

what is go-ora package version you use?
this message is very old

Yes that was it. I had downloaded it ages ago. I had use go mod to fetch the latest version but I didn't see in my make file that I used 111GOMODULES=OFF.  Oops.  Once I got the right version, it worked.


Link broken: 404

The link of [server side programming] (https://docs.microsoft.com/en-us/azure/cosmos-db/programming) is returning a 404

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f7e8d08b-7c18-5407-dc4f-fa7bbfe53fb3
Version Independent ID: da35a785-c7fe-57e8-2d02-3daefd0284da
Content: Use Azure Cosmos DB explorer to manage your data
Content Source: articles/cosmos-db/data-explorer.md
Service: cosmos-db
GitHub Login: @deborahc
Microsoft Alias: dech

@beatgates Thank you for the detailed feedback. This is being assigned to the content author to evaluate and update as appropriate.

@beatgates thanks for pointing out the issue, I submitted a PR to fix it. The changes should be live tomorrow. We will close this issue now.
#please-close


Pushing v6.32.2 to Microsoft store fails at missing "Endless Key.mp4"

We have a good demo video Endless Key.mp4 on Microsoft store since Submission 17.
However, pushing Alpha Test Flight to MS store becomes failed after "Submission 17" and shows error:
Write-Error: C:\Users\runneradmin\Documents\PowerShell\Modules\StoreBroker\1.21.0\StoreBroker\PackageTool.ps1:3760
Line |
3760 |          Write-Log -Exception $_ -Level Error
     |          ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     | 2023-08-10 03:46:04 : runneradmin :  Write-Log:
     | C:\Users\runneradmin\Documents\PowerShell\Modules\StoreBroker\1.21.0\StoreBroker\PackageTool.ps1:1279 Line |
     | 1279 |          Write-Log -Message $output -Level Error      |          ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     | | 2023-08-10 03:46:04 : runneradmin : Could not find media file [Endless Key.mp4] in any subdirectory of      |
     | [D:\a\endless-key-app\endless-key-app\MSAppPayload\PDPs\en-us].

Error: Process completed with exit code 1.

https://github.com/endlessm/endless-key-app/actions/runs/5816622993/job/15770191811

After check Store listing of Endless Key's Submission 17 on Microsoft store, there is a new trailer Endless Key.mp4 in Trailers and additional assets section.
StoreBroker's document gives the Trailers information and a PDP xml example:
<Trailers>
    <Trailer FileName="trailer1.mp4">
        <Title>This is the trailer's title</Title>
        <Images>
           <Image FileName="trailer1screenshot.png">The user will never see this text</Image>
        </Images>
    </Trailer>
</Trailers>

Each trailer has a image.

We still keep the idea:  Maintain the market related information on Microsoft store's dashboard.  CI gets the Application Payload from Microsoft store, then create a new one by referring & modifying the Application Payload with dummy asset files.  Finally, submit the new Application Payload as a submission to Alpha Test Flight.
So, we have to create dummy files for the trailer and its image.

The new submission to MS store's Alpha Test Flight works now. https://github.com/endlessm/endless-key-app/actions/runs/5819317415


APIM ( Api Management service ) - OAuth2 authorization_code return 404 in callback

Hi Guys,
I have a problem with the B2C authorization_code flow in OAuth2+OpenId connect of API management service.
I configured an AD authorization_code flow and it works better, I configured an IMPLICIT B2C (deprecated) flow an it works better also, but with the B2C authorization_code I obtain a 404 error in the callback page.
Here the configuration of OAuth2 in APIM:

The app registration has the callback configured as web ( I tested it also as SPA ):

Two different tokens enabled:

API permission ( is relevant only graph permission ):

If I run the b2c userflow with the jwt.ws callback it works an return the token, while testing it from APIM the default callback of Microsoft doesn't work returning a 404:

Someone of us can help me ? Is it a bug of APIM ?
Thanks

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 6515b078-b617-baf5-0e10-0001a6af887f
Version Independent ID: d40e7400-4c07-fe33-aca3-4dc8690c11d1
Content: Secure an Azure API Management API by using Azure Active Directory B2C
Content Source: articles/active-directory-b2c/secure-api-management.md
Service: active-directory
Sub-service: b2c
GitHub Login: @kengaderdus
Microsoft Alias: kengaderdus

@zaply
I'm going to assign this to the document author so they can take a look at it accordingly
@kengaderdus
Can you please check and add your comments on this doc update request as applicable.

Please @kengaderdus do you have a feedback  about this topic ?

@zaply
We've added this issue to our documentation backlog work item for internal tracking and prioritization. We'll update this issue as once we resolve the issue. Thanks again for your feedback. #please-close


Override vendor/device id (probably) doesn't work

Hi. I'm trying to override vendor/device ID, I put this into dxvk.conf:
d3d9.customVendorId = "10de"
d3d9.customDeviceId = "402"

But game (Fallout 3 launcher, actually) still reports that i have Intel GPU. That's what i see in d3d9.log:
info:  Effective configuration:
info:    d3d9.customDeviceId = "402"
info:    d3d9.customVendorId = "10de"

Can someone else test if vendor/device ID overriding works?
System information

GPU: Intel HD 630
Driver: Mesa 19.0.1
Wine version: 4.6
DXVK version: 331d883

Firstly, your device ID is invalid.
Secondly, it does not spoof the name of the device, just the device id, vendor id and the driver dll reported to the game.

Firstly, your device ID is invalid.

How will be correct, 0402?

it does not spoof the name of the device

Ok. I suppose this game (Fallout 3 launcher) reports device name according to its device ID. When i use WineD3D and spoof vendor/device ID through regedit the game reports that i have Nvidia GPU (GeForce 8600 GT in case of this device ID).

I also tried dxdiag. Spoofing works with WineD3D but with D9VK nothing changes no matter if i change only vendor ID or both vendor and device ID. With D9VK DxDiag always reports:
    Vendor ID: 0x8086
    Device ID: 0x5912

D9VK doesn't implement DXDiag, so if games query that you also need to setup the override in Wine.

Well, i think Fallout 3 doesn't use dxdiag. Anyway, i tested 3 different games/apps: Fallout 3, Braid and DxDiag.exe, and in all of them overriding vendor/device ID doesn't work with D9VK. I don't know, maybe i'm doing something wrong.

I don't think Dxdiag uses D3D9.

It uses d3d9, because when i disable d3d9.dll it doesn't reports vendor ID at all.

Firstly, your device ID is invalid.

How is correct, 0402? I tried 0402 and still nothing changes.

it does not spoof the name of the device

Ok. I suppose this game (Fallout 3 launcher) reports device name according to its device ID.
When i use WineD3D and spoof vendor/device ID through regedit the game reports that i have Nvidia GPU (GeForce 8600 GT in case of this device ID).

No, I stated the game stills hows the device name, but the device id, vendor and driver name are spoofed -- which is what the game actually checks to make decisions

Fallout 3 always changes graphics settings when hardware changes.
When i spoof vendor ID using WineD3D, F3 launcher changes graphics settings, and when i spoof it again to some different value and run launcher again then graphics settings changes again. But when i spoof vendor/device ID using D9VK nothing changes.
Same behavior in And as i said DxDiag.exe and Braid always shows the same IDs when i use D9VK. That's what DxDiag.exe (and Braid shows the same) reports:
Vendor ID: 0x8086
Device ID: 0x5912

What i'm trying to say is that spoofing works with WineD3D, but doesn't work with D9VK. At least doesn't work for me. What am I doing wrong?

@Joshua-Ashton I was able to spoof vendor and device ID by manually replacing lines in src/d3d9/d3d9_interface.cpp:
uint32_t vendorId = m_d3d9Options.customVendorId == -1 ? props.vendorID : uint32_t(m_d3d9Options.customVendorId);
pIdentifier->DeviceId = m_d3d9Options.customDeviceId == -1 ? props.deviceID : uint32_t(m_d3d9Options.customDeviceId);

with
uint32_t vendorId = 0x10de;
pIdentifier->DeviceId = 0x0402;

After that Fallout 3 working and doesn't crashes (as it crashes on Intel GPUs without spoofing) and DxDiag.exe reports:
    Vendor ID: 0x10DE
    Device ID: 0x0402

So spoofing using dxvk.conf file is broken, options just ignored or handled incorrectly. Maybe parsePciId function is broken?

@Joshua-Ashton I found out why spoofing doesn't works for me. The problem is in double quotes. This works:
d3d9.customVendorId = 10de
d3d9.customDeviceId = 0402

and this doesn't:
d3d9.customVendorId = "10de"
d3d9.customDeviceId = "0402"

Yeah, that'd cause it :P


Visualizer: fix of semantics editor

Couple of fixes on semantics editor:

Fix the argument display issue of Param expression
Fix the semantics editor open issue on Windows/Linux #129

lgtm


Private Cloud release March 18

Updated documentation and release notes for the upcoming Private Cloud Operator 1.9.0 release (March 18).
The Configuration Tool has been updated:

Git Bash (or Bash) is no longer required
Upgrading Mendix Operator is now much easier, no longer requiring manual steps
Migrating to a private registry no longer requires downloading and patching the installation script
In the future, customers would be able to install a specific version of the Mendix Operator instead of the latest one

The old Bash installation/reconfiguration scripts have been removed from the Private Cloud Portal and will no longer be available.
The Operator now supports a simpler way of setting scheduled events and app constants when running in standalone mode.

Hi @MarkvanMents, can you please publish the changes?
We've released the new version of Prtivate Cloud today.


Create installer for app

Currently, portable apps are available. However, it would be better if they had a proper installer.

Created installer for Windows, updated download file in Readme to utilize proper installer.

Done, links updated with MSI and DMG installers.


Dart2js does not substitute type parameters when checking type of const with instance var initialized at declaration site.

The following code is runs without errors in the VM in both checked and unchecked mode:
class A {
  const A();
}
class Test<T extends A> {
  final T x = const A();
  const Test();
}
main() {
  print(const Test<A>());
}
However, when dart2js is given this input and told to compile in checked mode, it produces the error:
../../../tmp/test.dart:5:3:
Error: 'A' is not assignable to 'T'.
  final T x = const A();
  ^^^^^^^^^^^^^^^^^^^^^^
../../../tmp/test.dart:5:3:
Error: 'A' is not assignable to 'T'.
  final T x = const A();
  ^^^^^^^^^^^^^^^^^^^^^^
Error: Compilation failed.
I believe the VM behavior is correct: the assignment of "const A()" to the instance variable x should happen in the context of evaluating the constant "const Test<A>()", thus type variable substitution should have changed the T into A, causing the type check to succeed.  Judging from dart2js's error message, it appears that it is not doing the type variable substitution properly.
The problem can be worked around by changing the main function to "print(new Test<A>());", dart2js produces code that runs without exceptions.  It can also be worked around by moving the initialization of x from the declaration of the field to the declaration of the constructor (i.e. "const Test() : x = const A();").  This suggests that the type check is only done incorrectly during constant evaluation, when the instance variable is initialized at the declaration site.

@hterkelsen Do we need to update tests/language/language_dart2js.status?  It still shows failures due to this bug.

Yes, I missed those when I submitted the change. I updated the status file in 4eb2f6694b5f450b17022eb7f3bce36daca9b5fe


Add test interface

#75
This adds a test interface that allows for injected operations to fully replace local defined operations and container base operations.
The idea behind this is that for testing porpuses is to be able to fully replace operations with injected ones, avoiding unwanted behavior in our tests.
My first idea was to add a class method to the transaction something like Transaction.enable_injection! but since the returning class after creating a transaction class is an anonymous class make it harder to add methods. I decided to use a wrapping module that injects this functionality by overwriting the resolve_operation method from the InstanceMethods module.
I think is a good start for improving the library and help user test their transaction classes.
@timriley WDYT?

Resolved in #109. Internal operations can now be replaced via constructor DI just like external operations, no special modes required.


added github ation to Publish versioned image

@rksharma95 i don't have access to merge and test these changes, so kindly do the needful


Improve structure of files

Closed issue #672

improved all the files structure
Corrected many images links which were not correctly writen

Hey @codervivek5 review it


Worked on the responsiveness for the users route

This PR...
Changes

Fixes

Checklist

[x] tested locally
[ ] added new dependencies
[ ] updated the docs
[ ] added/updated a component
[ ] fixed a bug
[ ] added/updated a new route
[x] added or changed css styles

Fixes #

Failed Checks.


Remove tag attributes in the system

All instances of tags and their test cases has been removed !
@domlimm could you pull this PR and do some testing before merging this in? I tested on my end already but just wanted to be sure !
closes #379

@tiewweijian will do. get back to you once im done! prob by late afternoon


vm_cpu_readings-file-x-of-125.csv.gz access denied

Howdy. I have been attempting to access some of the datasets available from the "AzurePublicDatasetV1Links.txt" file with no luck. I have attached the screenshot of the page I am directed to each time I attempt to click on any of the links. I have tried on multiple browsers and devices with no luck, copying the link or clicking on it via my IDE as well. Any response is greatly appreciated.

issue resolved! we updated the links.!


Failed to install thin-edge.io

Describe the bug
Hi there, this is just following the instructions on https://cumulocity.com/guides/device-integration/integration-tutorials/
To Reproduce
I am using a pi zero w 2 an this command: curl -fsSL https://raw.githubusercontent.com/thin-edge/thin-edge.io/main/get-thin-edge_io.sh | sudo sh -s
Expected behavior
I was expecting thin edge.io to download an install on my pi zero
Screenshots
Environment (please complete the following information):
--------------- machine details ---------------------
date:           Thu 18 Jan 22:01:56 GMT 2024
tedge:          1.0.0-rc.1
Machine:        Linux pizero 6.1.21-v8+ #1642 SMP PREEMPT Mon Apr  3 17:24:16 BST 2023 aarch64 GNU/Linux
Architecture:   arm64
Distribution:   Debian GNU/Linux 11 (bullseye)

Additional context
Error log:
--------------- error details ------------------------
Version argument has not been provided, installing latest: 1.0.0-rc.1
To install a particular version use this script with the version as an argument.
For example: sudo ./get-thin-edge_io.sh 1.0.0-rc.1
Installing for architecture arm64
Installing mosquitto as prerequisite for thin-edge.io
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  libcjson1 libdlt2 libev4 libmosquitto1 libwebsockets16
Suggested packages:
  apparmor
The following NEW packages will be installed:
  libcjson1 libdlt2 libev4 libmosquitto1 libwebsockets16 mosquitto
0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.
Need to get 637 kB of archives.
After this operation, 1,662 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian bullseye/main arm64 libcjson1 arm64 1.7.14-1 [22.5 kB]
Get:2 http://security.debian.org/debian-security bullseye-security/main arm64 libmosquitto1 arm64 2.0.11-1+deb11u1 [89.9 kB]
Get:3 http://deb.debian.org/debian bullseye/main arm64 libdlt2 arm64 2.18.6-1+deb11u1 [50.9 kB]
Get:4 http://deb.debian.org/debian bullseye/main arm64 libev4 arm64 1:4.33-1 [41.3 kB]
Get:5 http://deb.debian.org/debian bullseye/main arm64 libwebsockets16 arm64 4.0.20-2 [173 kB]
Get:6 http://security.debian.org/debian-security bullseye-security/main arm64 mosquitto arm64 2.0.11-1+deb11u1 [259 kB]
Fetched 637 kB in 1s (1,205 kB/s)
Selecting previously unselected package libcjson1:arm64.
(Reading database ... 37776 files and directories currently installed.)
Preparing to unpack .../0-libcjson1_1.7.14-1_arm64.deb ...
Unpacking libcjson1:arm64 (1.7.14-1) ...
Selecting previously unselected package libdlt2:arm64.
Preparing to unpack .../1-libdlt2_2.18.6-1+deb11u1_arm64.deb ...
Unpacking libdlt2:arm64 (2.18.6-1+deb11u1) ...
Selecting previously unselected package libev4:arm64.
Preparing to unpack .../2-libev4_1%3a4.33-1_arm64.deb ...
Unpacking libev4:arm64 (1:4.33-1) ...
Selecting previously unselected package libmosquitto1:arm64.
Preparing to unpack .../3-libmosquitto1_2.0.11-1+deb11u1_arm64.deb ...
Unpacking libmosquitto1:arm64 (2.0.11-1+deb11u1) ...
Selecting previously unselected package libwebsockets16:arm64.
Preparing to unpack .../4-libwebsockets16_4.0.20-2_arm64.deb ...
Unpacking libwebsockets16:arm64 (4.0.20-2) ...
Selecting previously unselected package mosquitto.
Preparing to unpack .../5-mosquitto_2.0.11-1+deb11u1_arm64.deb ...
Unpacking mosquitto (2.0.11-1+deb11u1) ...
Setting up libmosquitto1:arm64 (2.0.11-1+deb11u1) ...
Setting up libev4:arm64 (1:4.33-1) ...
Setting up libcjson1:arm64 (1.7.14-1) ...
Setting up libdlt2:arm64 (2.18.6-1+deb11u1) ...
Setting up libwebsockets16:arm64 (4.0.20-2) ...
Setting up mosquitto (2.0.11-1+deb11u1) ...
Created symlink /etc/systemd/system/multi-user.target.wants/mosquitto.service → /lib/systemd/system/mosquitto.service.
Processing triggers for man-db (2.9.4-2) ...
Processing triggers for libc-bin (2.31-13+rpt2+rpi1+deb11u7) ...
curl: (22) The requested URL returned error: 404
Failed to install thin-edge.io
Reason: Could not download package from url: https://github.com/thin-edge/thin-edge.io/releases/download/1.0.0-rc.1/tedge_1.0.0-rc.1_arm64.deb
Please create a ticket using the following link and include the console output
    https://github.com/thin-edge/thin-edge.io/issues/new?assignees=&labels=bug&template=bug_report.md
------------------------------------------------------

Thanks @Jack-Moss, we'll have to update the instructions referenced from the Cumulocity IoT docs.
There is a new(ish) install script to install via our official linux packages hosted on Cloudsmith.io, you can check out the installation instructions here:
https://thin-edge.github.io/thin-edge.io/install/
But in general, if you run into any unexpected errors, then it is always good to have a look at the project's official documentation page, as it is always in sync with the project as the documentation is hosted next to the code. The pages hosted on under the Cumulocity IoT domain unfortunately aren't automatically synced at this point in time.
Official/full documentation
https://thin-edge.github.io/thin-edge.io/

I've create a ticket to track the updating of the Cumulocity IoT tutorial page. https://github.com/thin-edge/thin-edge.io/issues/2604

@Jack-Moss Please let us know if the install instructions on the project's documentation page work for you.

Closing. Please reopen the ticket if the above suggestion does not work.


View controls not working on mobile devices

The zoom in/out and rotate controls are disabled. Also, the previous/next page controls inadvertently download PDF file which consumes huge mobile data.
The dashboard has shown an unusual increase in 'download'. So I assume our users are accidentally downloading the PDF file instead of paginating.

And clicking on a page in the grid view sometimes takes you to the Creative Commons page.

@gestchild Can you please look at this: previous/next controls downloading PDF file is the part to address first as it's causing people to use data to download when that isn't their intention


How to make the generation of existing models more refined

@libai-lab Hi, you may try training for longer iters, but there are many parameters to tune for gaussian splatting.


The reply url specified in the request does not match the reply urls configured for the application

Hi,
I have integrated your php code for Azure AD, however I am getting this error:
AADSTS50011: The reply url specified in the request does not match the reply urls configured for the application.
There are no more reply urls, but I believe redirect Urls are the same thing. I have added a redirect url in authentication for my app in Azure AD, but I am still getting this error, is there any other setting I need to check?
Please let me know if there are any additional details you may require for the same.

you need to specify the reply url in your azure portal in your app settings
maybe something like this : https://mybeautifulapp/connect/check/azure
Hope it will help

The same issue look related to "CSRF attack if" in my case.
Can somebody try with the example code and tell me if the same issue occurs or it’s just for me ?
I already have configure the uri in app settings.

Can you please give some example of the code and configuration? Screens from Azure Portal of the redirect URI setup as well please.


update dotnet -i

Fixes #4545
@danroth27 @mlorbetske please review and let me know if there's a better package for the example
I also update the version of the topic to say 2.0 since we haven't added the 2.1 options yet

Looks good to me, but @mlorbetske should really review this.

Build seemed stuck


Postman inference fails

For support questions, please use the Stoplight Community Forum. This repository's issues are reserved for feature requests and bug reports. If you are unsure if you are experiencing a bug, the Community Forum is a great place to start.
Please delete this section, any any sections below that you don't use, before creating the issue.

Describe the bug
I have an API of which I only have the Postman files. I generated examples for almost all endpoints, however, there's a problem with an endpoint which accepts multiple bodies.
To Reproduce
I have the following two sample POST requests in Postman:
{
  "to": "342334535335",
  "type": "text",
  "recipient_type": "individual",
  "text": {
    "body": "Welcome"
  }
}

{
	"to": "344455434",
	"type": "image",
	"recipient_type": "individual",
	"image": {
		"caption": "Quo Vadis",
		"id": "2bd2826a-c9ed-431d-beb6-f0eed5c24382"
	}
}

They go to the same endpoint: POST /v1/messages. With the first one, I succesfully get the mock result, but with the second I get the following error:
{"type":"https://stoplight.io/prism/errors#UNPROCESSABLE_ENTITY","title":"Invalid request body payload","status":422,"detail":"Your request is not valid and no HTTP validation response was found in the spec, so Prism is generating this error for you.","validation":[{"location":["body"],"severity":"Error","code":"required","message":"should have required property 'text'"}]}

Is there any way to remove the constraint of text being a required property?
Expected behavior
Both should return a mocked response

Hola @aarroyoc,
por lo que veo en el poco que pegaste, Prism se esta lamentando de la falta del campo text en tu solicitud web.
Me facilitaría mucho darte una respuesta precisa si pudieses compartir el documento Postman que estas usando.
Un saludo
P.S: Vivo en Austin pero viví en Madrid por largo tiempo y de hecho voy a regresar este Julio por vacaciones :)

Jeje, menuda sorpresa! La colección de Postman que estoy intentanto mockear es esta: https://github.com/fbsamples/WhatsApp-Business-API-Postman-Collection


[compiler] fix SmallVector constructor in DimFromBroadcast.cpp

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


fmriprep pause during anatomical recontruction step

What happened?
We are running fmriprep on a SLURM compute cluster, the process is paused and does not exit.
Hence our slurm job exit when it timeout (and we don't have access to the working directory, which is saved on the compute node).
What command did you use?
singularity run --cleanenv -B $SLURM_TMPDIR:/DATA -B /home/ltetrel/.cache/templateflow:/templateflow -B /etc/pki:/etc/pki/ -B /scratch/ltetrel/cima-q/1636990190:/OUTPUT /lustre03/project/6003287/containers/fmriprep-20.2.1lts.sif -w /DATA/fmriprep_work --participant-label 9929164   --bids-filter-file /OUTPUT/bids_filters.json   --output-spaces MNI152NLin2009cAsym MNI152NLin6Asym anat fsnative --output-layout bids --notrack --skip_bids_validation --write-graph --omp-nthreads 8 --nprocs 16 --mem_mb 65536 --resource-monitor /DATA/cima-q /DATA/cima-q/derivatives/fmriprep participant

What version of fMRIPrep are you running?
20.2.1lts
How are you running fMRIPrep?
Singularity
Is your data BIDS valid?
Yes
Are you reusing any previously computed results?
No
Please copy and paste any relevant log output.
Last command (process is paused at this stage):

211123-20:40:39,959 nipype.workflow INFO:
	 [Node] Finished "fmriprep_wf.single_subject_9929164_wf.anat_preproc_wf.anat_norm_wf.trunc_mov".

Error log:

/usr/local/miniconda/lib/python3.7/site-packages/bids/layout/validation.py:46: UserWarning: The ability to pass arguments to BIDSLayout that control indexing is likely to be removed in future; possibly as early as PyBIDS 0.14. This includes the `config_filename`, `ignore`, `force_index`, and `index_metadata` arguments. The recommended usage pattern is to initialize a new BIDSLayoutIndexer with these arguments, and pass it to the BIDSLayout via the `indexer` argument.
  warnings.warn("The ability to pass arguments to BIDSLayout that control "
exception calling callback for <Future at 0x2ae3ce4e3390 state=finished raised FileNotFoundError>
concurrent.futures.process._RemoteTraceback:
"""
Traceback (most recent call last):
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/plugins/multiproc.py", line 67, in run_node
    result["result"] = node.run(updatehash=updatehash)
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/engine/nodes.py", line 486, in run
    self._get_hashval()
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/engine/nodes.py", line 538, in _get_hashval
    self._get_inputs()
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/engine/nodes.py", line 609, in _get_inputs
    self.set_input(key, deepcopy(output_value))
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/engine/nodes.py", line 302, in set_input
    setattr(self.inputs, parameter, deepcopy(val))
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/interfaces/base/traits_extension.py", line 426, in validate
    value = super(MultiObject, self).validate(objekt, name, newvalue)
  File "/usr/local/miniconda/lib/python3.7/site-packages/traits/trait_types.py", line 2336, in validate
    return TraitListObject( self, object, name, value )
  File "/usr/local/miniconda/lib/python3.7/site-packages/traits/trait_handlers.py", line 2313, in __init__
    raise excp
  File "/usr/local/miniconda/lib/python3.7/site-packages/traits/trait_handlers.py", line 2305, in __init__
    value = [ validate( object, name, val ) for val in value ]
  File "/usr/local/miniconda/lib/python3.7/site-packages/traits/trait_handlers.py", line 2305, in <listcomp>
    value = [ validate( object, name, val ) for val in value ]
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/interfaces/base/traits_extension.py", line 330, in validate
    value = super(File, self).validate(objekt, name, value, return_pathlike=True)
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/interfaces/base/traits_extension.py", line 135, in validate
    self.error(objekt, name, str(value))
  File "/usr/local/miniconda/lib/python3.7/site-packages/traits/trait_handlers.py", line 172, in error
    value )
traits.trait_errors.TraitError: Each element of the 't2w_list' trait of a _FSDetectInputsInputSpec instance must be a pathlike object or string representing an existing file, but a value of '/DATA/cima-q/sub-9929164/ses-V03/anat/sub-9929164_ses-V03_T2w.nii.gz' <class 'str'> was specified.
Error setting node input:
Node: recon_config
input: t2w_list
results_file: /DATA/fmriprep_work/fmriprep_wf/single_subject_9929164_wf/bidssrc/result_bidssrc.pklz
value: /DATA/cima-q/sub-9929164/ses-V03/anat/sub-9929164_ses-V03_T2w.nii.gz
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/miniconda/lib/python3.7/concurrent/futures/process.py", line 232, in _process_worker
    r = call_item.fn(*call_item.args, **call_item.kwargs)
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/plugins/multiproc.py", line 70, in run_node
    result["result"] = node.result
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/engine/nodes.py", line 217, in result
    op.join(self.output_dir(), "result_%s.pklz" % self.name)
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/engine/utils.py", line 291, in load_resultfile
    raise FileNotFoundError(results_file)
FileNotFoundError: /DATA/fmriprep_work/fmriprep_wf/single_subject_9929164_wf/anat_preproc_wf/surface_recon_wf/recon_config/result_recon_config.pklz
"""
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/miniconda/lib/python3.7/concurrent/futures/_base.py", line 324, in _invoke_callbacks
    callback(self)
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/plugins/multiproc.py", line 159, in _async_callback
    result = args.result()
  File "/usr/local/miniconda/lib/python3.7/concurrent/futures/_base.py", line 425, in result
    return self.__get_result()
  File "/usr/local/miniconda/lib/python3.7/concurrent/futures/_base.py", line 384, in __get_result
    raise self._exception
FileNotFoundError: /DATA/fmriprep_work/fmriprep_wf/single_subject_9929164_wf/anat_preproc_wf/surface_recon_wf/recon_config/result_recon_config.pklz

Additional information / screenshots
We have a datalad dataset where we datalad get just the T1 and func. There are also t2w and flair but we ignore them (empty symlinks).
Since we thought this was an issue where fmriprep see the files (think it exists), we added a bids_filter to ignore these (empty) files. But that did not change the error that we see.
{
  "fmap": {"datatype": "fmap"},
  "bold": {"datatype": "func", "suffix": "bold"},
  "t1w": {"datatype": "anat", "suffix": "T1w"},
  "roi": {"datatype": "anat", "suffix": "roi"}
}

It looks like the cache may have gotten messed up. Can you try clearing it and then re-running? Also, you can use --ignore t2w flair in place of --bids-filter-file in this case.
BTW- The 20.1.x series is not LTS - that is 20.2.x

It looks like the cache may have gotten messed up. Can you try clearing it and then re-running? Also, you can use --ignore t2w flair in place of --bids-filter-file in this case.

Regarding the cache, we are using a compute node , so the clache should be cleared each time. I was not aware of the option --ignore t2w flairthanks I will try.

BTW- The 20.1.x series is not LTS - that is 20.2.x

uups my bad it is 20.2.1lts, just modified it on the issue.

Ah, I see the problem - these are the default queries fMRIPrep uses:
{
  "fmap": {"datatype": "fmap"},
  "bold": {"datatype": "func", "suffix": "bold"},
  "sbref": {"datatype": "func", "suffix": "sbref"},
  "flair": {"datatype": "anat", "suffix": "FLAIR"},
  "t2w": {"datatype": "anat", "suffix": "T2w"},
  "t1w": {"datatype": "anat", "suffix": "T1w"},
  "roi": {"datatype": "anat", "suffix": "roi"},
}

If adding special filtering with --bids-filter-file, the entries you provide will overwrite the defaults, but any scantype omitted will be set to the default listed above. The --ignore method should work, but if you wished to use --bids-filter-file, I think you would need to supplement your file with:
{
  "fmap": {"datatype": "fmap"},
  "bold": {"datatype": "func", "suffix": "bold"},
  "t1w": {"datatype": "anat", "suffix": "T1w"},
  "roi": {"datatype": "anat", "suffix": "roi"},
  "t2w": null,
  "flair": null
}

Ok! I was confused by the bids_filter definition, there is no instruction on the BIDS documentation for that file, just yours.
I will try with this new bids_filter, and let you know. It may take a while (time to have job queued and processed etc..).

So I tried with the bids_filters.json that you proposed, unfortunately I got the following error:
/usr/local/miniconda/lib/python3.7/site-packages/bids/layout/validation.py:46: UserWarning: The ability to pass arguments to BIDSLayout that control indexing is likely to be removed in future; possibly as early as PyBIDS 0.14. This includes the `config_filename`, `ignore`, `force_index`, and `index_metadata` arguments. The recommended usage pattern is to initialize a new BIDSLayoutIndexer with these arguments, and pass it to the BIDSLayout via the `indexer` argument.
  warnings.warn("The ability to pass arguments to BIDSLayout that control "
Traceback (most recent call last):
  File "/usr/local/miniconda/bin/fmriprep", line 10, in <module>
    sys.exit(main())
  File "/usr/local/miniconda/lib/python3.7/site-packages/fmriprep/cli/run.py", line 17, in main
    parse_args()
  File "/usr/local/miniconda/lib/python3.7/site-packages/fmriprep/cli/parser.py", line 713, in parse_args
    config.execution.init()
  File "/usr/local/miniconda/lib/python3.7/site-packages/fmriprep/config.py", line 467, in init
    for k, v in filters.items()
AttributeError: 'Query' object has no attribute 'items'

Anyway we finally decided to process the dateset with also FLAIR and T2* and the preprocessing went well this time.


Return subscription ID in gRPC subscribe request

Signed-off-by: Pravin Pushkar<EMAIL_ADDRESS>Please reference the issue this PR will close: #5160

/ok-to-test

/ok-to-test

/ok-to-test


UpnpListener encountered an error sending upnp response packet. IP: 192.168.X.X with message: Host is down

My logs are riddled with these errors.  When I ask Alexa to do stuff it says the device didn't respond.  I can, most of the time, ask again and it will work.  Today I got into a shouting match with the Alexa because she refused to listen at all.
Not sure how to avoid this problem but I really would like to resolve it. Thanks!

If you could post your log from the start of the ha-bridge that would be appreciated

My logs were completely filled with the upnp error so I restarted the server.  Here are the details of my server from the logs after the restart, sir:

11-19-2020 11:54:39.470
INFO
HA Bridge startup sequence...
com.bwssystems.HABridge.HABridge

11-19-2020 11:54:39.626
INFO
HA Bridge (v5.3.0) initializing....
com.bwssystems.HABridge.HABridge

11-19-2020 11:54:39.641
INFO
reading from config file: data/habridge.config
com.bwssystems.HABridge.BridgeSettings

11-19-2020 11:54:39.784
WARN
The upnp config address, <IP_ADDRESS>, does not match any known IP's on this host. Using default address: null
com.bwssystems.HABridge.BridgeSettings

11-19-2020 11:54:42.534
INFO
StaticResourceHandler configured with folder = /public
spark.staticfiles.StaticFilesConfiguration

11-19-2020 11:54:42.555
INFO
System control service started....
com.bwssystems.HABridge.SystemControl

11-19-2020 11:54:42.959
INFO
Initializing UDP response Socket...
com.bwssystems.HABridge.util.UDPDatagramSender

11-19-2020 11:54:42.977
INFO
UDP response Socket initialized to: 50000
com.bwssystems.HABridge.util.UDPDatagramSender

11-19-2020 11:54:42.981
INFO
HTTP Home created.
com.bwssystems.HABridge.plugins.http.HTTPHome

11-19-2020 11:54:42.986
INFO
Harmony Home created. No Harmony devices configured.
com.bwssystems.HABridge.plugins.harmony.HarmonyHome

11-19-2020 11:54:43.380
INFO
Nest Home created. No Nest configured.
com.bwssystems.HABridge.plugins.NestBridge.NestHome

11-19-2020 11:54:43.383
INFO
Hue passthru Home created. No Hue passtrhu systems configured.
com.bwssystems.HABridge.plugins.hue.HueHome

11-19-2020 11:54:43.417
INFO
HAL Home created. No HAL devices configured.
com.bwssystems.HABridge.plugins.hal.HalHome

11-19-2020 11:54:43.418
INFO
MQTT Home created. No MQTT Clients configured.
com.bwssystems.HABridge.plugins.mqtt.MQTTHome

11-19-2020 11:54:43.420
INFO
HomeAssistant Home created. No HomeAssistants configured.
com.bwssystems.HABridge.plugins.hass.HassHome

11-19-2020 11:54:43.421
INFO
HomeWizard Home created. No HomeWizard gateways configured.
com.bwssystems.HABridge.plugins.homewizard.HomeWizardHome

11-19-2020 11:54:43.422
INFO
Command Home for system program execution created.
com.bwssystems.HABridge.plugins.exec.CommandHome

11-19-2020 11:54:43.425
INFO
TCP Home created.
com.bwssystems.HABridge.plugins.tcp.TCPHome

11-19-2020 11:54:43.535
INFO
UDP Home created.
com.bwssystems.HABridge.plugins.udp.UDPHome

11-19-2020 11:54:43.622
INFO
Vera Home created. No Veras configured.
com.bwssystems.HABridge.plugins.vera.VeraHome

11-19-2020 11:54:43.624
INFO
Fibaro Home created. No Fibaros configured.
com.bwssystems.HABridge.plugins.fibaro.FibaroHome

11-19-2020 11:54:43.626
INFO
Domoticz Home created. No Domoticz devices configured.
com.bwssystems.HABridge.plugins.domoticz.DomoticzHome

11-19-2020 11:54:43.628
INFO
Somfy Home created. No Somfys configured.
com.bwssystems.HABridge.plugins.somfy.SomfyHome

11-19-2020 11:54:43.860
INFO
LifxDevice Home created. No LifxDevices configured.
com.bwssystems.HABridge.plugins.lifx.LifxHome

11-19-2020 11:54:43.862
INFO
OpenHAB Home created. No OpenHABs configured.
com.bwssystems.HABridge.plugins.openhab.OpenHABHome

11-19-2020 11:54:43.865
INFO
FHEM Home created. No FHEMs configured.
com.bwssystems.HABridge.plugins.fhem.FHEMHome

11-19-2020 11:54:43.879
INFO
Broadlink Home created. No Broadlinks configured.
com.bwssystems.HABridge.plugins.broadlink.BroadlinkHome

11-19-2020 11:54:43.881
INFO
Mozilla IOT Home created. No Mozilla IOTs configured.
com.bwssystems.HABridge.plugins.moziot.MozIotHome

11-19-2020 11:54:43.883
INFO
HomeGenie Home created. No HomeGenies configured.
com.bwssystems.HABridge.plugins.homegenie.HomeGenieHome

11-19-2020 11:54:43.927
INFO
HABridge device management service started....
com.bwssystems.HABridge.devicemanagmeent.DeviceResource

11-19-2020 11:54:43.949
INFO
== Spark has ignited ...
spark.embeddedserver.jetty.EmbeddedJettyServer

11-19-2020 11:54:43.949
INFO
>> Listening on <IP_ADDRESS>:80
spark.embeddedserver.jetty.EmbeddedJettyServer

11-19-2020 11:54:44.503
INFO
Hue emulator service started....
com.bwssystems.HABridge.hue.HueMulator

11-19-2020 11:54:44.991
INFO
Description xml service started....
com.bwssystems.HABridge.upnp.UpnpSettingsResource

11-19-2020 11:54:45.007
INFO
UPNP Discovery Listener starting....
com.bwssystems.HABridge.upnp.UpnpListener

11-19-2020 11:54:45.009
INFO
Create and run mDNS service.
com.bwssystems.HABridge.upnp.UpnpListener

11-19-2020 11:54:45.160
INFO
UPNP Discovery Listener running and ready....
com.bwssystems.HABridge.upnp.UpnpListener

So the the third item shows the issue. The IP in the config is not matching any known IPs on the server and the default selection of null points to the ha-bridge not being able to find the correct interface. Are there multiple interfaces on your system?

There is only on ip on the machine and one interface.  Screen Shot 2020-11-19 at 12 35 40 PM

https://github.com/bwssytems/ha-bridge/issues/470
There are issues the way the mac OSX handles interfaces if you start the ha-bridge as a user. You will need to use sudo on the command line.

This server had been configured for quite some time so I honestly have no idea how it is enabled from the beginning.  Do you think once I make that change it will work properly?

IF you could turn on traceupnp, save the config, restart and post the log again, that would help

I enabled and tried to turn on some lights got the following.  Once I wake it up and I ask a second time it usually works.

11-19-2020 13:42:27.901
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: No route to host
com.bwssystems.HABridge.upnp.UpnpListener

11-19-2020 13:42:28.646
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-19-2020 13:42:29.405
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-19-2020 13:42:30.089
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-19-2020 13:47:35.510
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: No route to host
com.bwssystems.HABridge.upnp.UpnpListener

11-19-2020 13:47:36.219
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-19-2020 13:47:36.982
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-19-2020 13:47:37.703
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

Ignorantly I can't find how the bridge is started in OSX.  LIke I said its been quite some time since I set it up.    If you have any insight in OSX how I can review I will see how / who is running the bridge. Thanks!

I am running it as a plist within /Library/LaunchDaemons/. File contents to follow.  Do you think I need to run this somehow with sudo still?

Label
HA-Bridge
ProgramArguments

java
-jar
ha-bridge.jar

RunAtLoad

KeepAlive

StandardErrorPath
/var/log/ha-bridge_err.log
StandardOutPath
/var/log/ha-bridge.log
WorkingDirectory
/Users/MYUSERNAME/ha-bridge-master/target

My system is working - just mostly not the first call.

I still need to see the log from the very beginning of startup with traceupnp turned on...

I enable traceupnp and it doesn't show any data in the logs and continues to show warn or info - any other setting. Why can't traceupnp "stick"?

You need to hit save at the top of the page for it to stick

I don't think I am a total moron- but I could be wrong.  In the logging section, I try to change to "trace" and hit the update log levels but it doesn't stick.  Am I in the wrong place?

It is a setting in the bridge control tab called traceupnp and it is a checkbox. You need to set that and hit save at the top of the page.

Mine is currently unchecked which says false:
UPNP Original (simple version) | false
Trace UPNP Calls | false
Trace State Changes | false

Check Trace UPNP Calls to true and save the setting

Did that.  Is the time in the logs based on system time?  I had an incident just now (7:17 AM) where the system didn't respond to the first verbal command but the second one did work.  Logs indicate nothing for over an hour.  See below (not dissimilar to log output before enabling traces)

11-23-2020 15:13:15.067
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 15:13:15.779
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 15:13:16.529
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 16:08:27.106
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: No route to host
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 16:08:27.887
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 16:08:28.587
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 16:08:29.371
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 17:15:34.566
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: No route to host
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 17:15:35.337
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 17:15:36.070
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 17:15:36.837
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 17:59:21.487
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: No route to host
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 17:59:22.204
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 17:59:22.954
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 20:09:21.057
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: No route to host
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 20:09:21.840
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 20:09:22.534
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 20:09:23.323
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 22:13:17.531
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: No route to host
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 22:13:18.322
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 22:13:19.031
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-23-2020 22:13:19.783
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 00:05:47.683
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: No route to host
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 00:05:48.463
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 00:05:49.156
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 00:05:49.946
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 01:59:33.627
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: No route to host
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 01:59:34.419
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 01:59:35.211
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 01:59:35.960
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 04:09:15.741
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: No route to host
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 04:09:16.529
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 04:09:17.246
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 04:09:18.029
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 06:06:35.957
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: No route to host
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 06:06:36.674
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 06:06:37.424
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

11-24-2020 06:06:38.174
WARN
UpnpListener encountered an error sending upnp response packet. IP: <IP_ADDRESS> with message: Host is down
com.bwssystems.HABridge.upnp.UpnpListener

I need you to post the log that is on the system with all messages from the time of start of the ha-bridge. Portions do not help me. If you are not sure how to do this, please google it.

I am technical - which log. Its not clear what you want? You want the entire log from this machine for HA-Bridge?  Can I email that to you rather than publically provide it?

Are the trace upnp logs part of the "regular" logs?  I am making calls and there are 0 entries to indicate turning on or off loads.  I restarted the bridge and confirmed this so I need clarification so I can provide you with the proper details.

Now it never works.  Last entry:
Traceupnp: hue api user create requested for device type: test_ha_bridge#<IP_ADDRESS> and username: 0d2048f6123448b18f6e36b3caadbcaf


Full screen mode is always failing by a few pixels on bottom of the screen

I'm executing on Windows 10. Always a few pixels line is showing at the bottom of the screen making visible the next windows on the stack. I searched on Google and somebody gets the same error. Any suggestion?
https://stackoverflow.com/questions/73229175/flutter-window-manager-fullscreen-embedded-webview-windows-not-displaying-fullsc

Excellent. Good work


TagBot trigger issue

This issue is used to trigger TagBot; feel free to unsubscribe.
If you haven't already, you should update your TagBot.yml to include issue comment triggers.
Please see this post on Discourse for instructions and more details.
If you'd like for me to do this for you, comment TagBot fix on this issue.
I'll open a PR within a few hours, please be patient!

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/52762

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/52976

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/72254

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/76911

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/103324

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/106527


cgo-gcc-prolog:94:2: warning: ‘cupsGetPPD3’ is deprecated: Use cupsCopyDestInfo and friends instead. [-Wdeprecated-declarations]

$ go get -insecure -u github.com/google/cloud-print-connector/...
# github.com/google/cloud-print-connector/cups
cgo-gcc-prolog: In function ‘_cgo_174ba0cb753c_Cfunc_cupsGetPPD3’:
cgo-gcc-prolog:94:2: warning: ‘cupsGetPPD3’ is deprecated: Use cupsCopyDestInfo and friends instead. [-Wdeprecated-declarations]
In file included from src/github.com/google/cloud-print-connector/cups/cups.h:15,
                 from src/github.com/google/cloud-print-connector/cups/core.go:14:
/usr/include/cups/ppd.h:369:22: note: declared here
  369 | extern http_status_t cupsGetPPD3(http_t *http, const char *name, time_t *modtime, char *buffer, size_t bufsize) _PPD_DEPRECATED;
      |                      ^~~~~~~~~~~

Same issue here

same issue here


Kernel options cleanup

Description of changes
All commits should be a no-op / no change on x86_64 and should help better support non-x86 platforms (namely aarch64) by conditioning some x86 specific stuff.
Dropped pre-4.9 stuff since that is the oldest supported kernel.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

/marvin opt-in
/status needs_reviewer


Error on npm run server in the starting-point branch

Error code below:
> babel-node server.js

sh: babel-node: command not found
npm ERR! file sh
npm ERR! code ELIFECYCLE
npm ERR! errno ENOENT
npm ERR! syscall spawn
npm ERR<EMAIL_ADDRESS>server: `babel-node server.js`
npm ERR! spawn ENOENT
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>server script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR!


Support Arrow columnar format v1.4

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
My initial problem was "I'm not sure what version of the Arrow spec(s) the arrow crate complies with". Documenting the level of support would be great.
After some searching it seems that the arrow crate presently supports "Arrow columnar format version 1.3", as defined here: https://github.com/apache/arrow/blob/3fe598ae4dfd7805ab05452dd5ed4b0d6c97d8d5/format/Schema.fbs#L20-L26
I'm creating this tracking issue since I didn't see anything about 1.4 by trying obvious searches in GitHub issue search. To be clear, I'm not suffering from a lack of support for 1.4 features currently.
Describe the solution you'd like
Support everything in Arrow columnar format version 1.4. Based on

https://github.com/apache/arrow/commit/9d6d501fb654a93496070b59fbe7f36f4f1ed604, which initially defined 1.4
https://github.com/apache/arrow/commit/6d551aa88237325978f51dbe02773a0aec2bfe9d, which retroactively added to 1.4

This would include support for

[ ] https://github.com/apache/arrow-rs/issues/3520
[ ] https://github.com/apache/arrow-rs/issues/5374
[ ] https://github.com/apache/arrow-rs/issues/5375

Describe alternatives you've considered
Declare an intention not to support things from 1.4, giving some rationale.
Additional context
n/a

FWIW we don't currently support the array view types for which this functionality was added -  https://github.com/apache/arrow-rs/issues/4253
Always happy to review documentation PRs

Filed https://github.com/apache/arrow-rs/issues/5374 to track adding StringViewArray and https://github.com/apache/arrow-rs/issues/5375 to track adding ListViews and I updated the description on this ticket

Similarly, I added a reference to #3520 , where the RunEndEncoded type was actually designated as part of columnar format v1.3.

Closed by #5502, follow on work to flesh out support for ListView and StringViewArray are tracked in #5375 and #5374


Upgrades node-hid.

node-hid 0.5.7 won't install from binaries under node 8.  This was fixed in node-hid 0.5.7.  I verified locally that my stuff still works fine when ledgerco uses node-hid 0.5.7, and the author of that library seems to follow semver so I don't think there are any breaking changes.

What is the status of a new NPM build?  Glancing at current NPM version and GitHub releases history, it appears the last release was on May 24th.

I'm going to merge #26 in the coming days, then release as 1.2.0


Update release-notes-ssms.md

@nnpcYvIVl : Thanks for your contribution! The author, @stevestein, has been notified to review your proposed change.

Verified editorial corrections.


Update key event property - Closes Issue #4040

Related to Redux Fundamentals Tutorial - Part 5, UI & React. Previously
the handleKeyDown event handler was evaluating key press values using
e.which, which is deprecated. Updated to e.key. This property has
wide browser
support

name: :memo: Documentation Fix
about: Fixing a problem in an existing docs page
Checklist

[√ ] Is there an existing issue for this PR?

Issue

[ ] Have the files been linted and formatted?

What docs page needs to be fixed?

Section:  Redux Fundamentals, Part 5 : UI & React
Page:  Dispatching Actions with useDispatch()

What is the problem?

The keydown event listener is comparing the key value using a deprecated property, e.which.

What changes does this PR make to fix the problem?

Updated to e.key, which has wide browser support.

Thanks!

My pleasure!


Feature request: skip/disable "Instrumental" Tracks

Hi, thanks for that awesome player.
I have a little feature request. Should be easy to build (like the "skip disliked songs"). Just another checkbox, to skip all tracks which ends with "(Instrumental)".

Should be easy to build

It's not easy to build, in fact it's basically not possible from our side of things.  We can skip disliked songs because there is something in the UI for each song with no user interaction that shows whether it's liked or not.  Genre's are behind several fetch requests and user interactions.
Would ask Google for this on their product forums

Thats not a specific "Genre". I'm talking about the Track title, "(Instrumental)" is a part of it. Track titles should be available without additional requests.


[DRAFT] add support of MI3XX for tf1.15 + py310

Description
TF 1.15 is very old which does to consider the changes of Numpy ABI and updates after python 3.10.
So we need to fix those problems to make sure TF 1.15 is well supported for existing customers.
The difficulty of changes of Numpy since 1.19 requires us to have tensorflow build numpy 1.19 by applying changes in numpy side.
However python 3.10 does not work with numpy < 1.24, due to numpy ABI changes which requires more changes from numpy side (unlike to apply patches upon python + Cython)
Soluiton
Two relase for Tf1.15:

Tf1.15+py3.8/py3.9 : this release is used for tensorflow 1.15 with python <= 3.9, numpy < 1.19.0

Tf1.15+py3.10/py3.12: this release is used for latest optimizatoin could be applied upon tf1.15 with python >= 3.10, numpy >= 1.24

Both versions have fixed protobuf 3.8.0 but we need make sure protobuf works well with python3.x.
Previously we only have ROC6.1 image for python 3.10 and tensorflow 2.x, for the successive release we should have

ROC6.1_tf1.15_py38/py39
ROC6.1_tf2.6_py310/py312

thank you @fsx950223 for the fix to support py38+tf1.15


Cog 533 pydantic unit tests

Summary by CodeRabbit
Release Notes

New Features

Introduced a benchmarking script to evaluate the performance of graph generation based on recursive organizational structures.
Added new utility functions for merging dictionaries and creating recursive society structures.
Implemented a new test suite to validate the functionality of the graph model generation.

Bug Fixes

Enhanced type safety in handling graph edges and nodes.

Refactor

Simplified logic in the get_graph_from_model and get_model_instance_from_graph functions for better readability and maintainability.
Updated test functions to improve structure and focus on specific relationships within the graph model.
Ensured models are rebuilt before being returned in the storage utility functions.

Documentation

Improved test assertions and messages for better debugging and clarity.

Hey @borisarzentar,
I created two pydantic Classes, Organization and SocietyPerson, that contain each other. A nested pydantic structure of this kind is created by calling create_organization_recursive in the file get_model_instance_from_graph_generative_test.py.
Weirdly, the get_model_instance_from_graph call fails in Python 3.9 and 3.10, but succeeds in 3.11. The issue seems to be that the pydantic class SocietyPerson is undefined in the call to model = create_model(model.__name__, **final_fields) for reconstructing Organization. Python 3.11 seems to have solved this issue, although I'm unsure why/how. For now, I'm just skipping these tests for Python 3.9 and 3.10 and I have added a bug ticket.
Thanks!
Leon


Progress/trigger on multiple contexts

Currently there seems to be issues with making progress and trigger subcalls within a callback that is called by a first HG_Trigger() call.

This is not allowed.


Installing OpenJDK pulls in X11 libraries even on servers

Basic info

Kernel: N/A
System: NixOS (Any Version)
Nix version: nix-env (Nix) 1.11.2
Nixpkgs version: 16.09pre79463.d88ae10

Describe your issue here
Installing OpenJDK on NixOS pulls in X11 libraries even when the system is a GUI-less server. This results in unnecessary dependencies, as any package that depends on a JDK will cause OpenJDK to be installed, which will in turn cause the X11 libraries to be pulled in, which will in turn cause the dependencies of the X11 libraries to be pulled in and so on and so forth.
The unnecessary dependencies are installed regardless of if the program that depends on the JDK uses the Java GUI libraries.
Expected result
X11 libraries and their dependencies are only installed if the system has GUI functionality enabled.
Actual result
X11 libraries and their dependencies are always installed.
Steps to reproduce
Install any package on NixOS that depends on a JDK.

This might be possible with jigsaw and openjdk 9 but nontrivial for older
jdks
On Thu, Mar 31, 2016 at 8:54 AM Philip Wernersbach<EMAIL_ADDRESS>wrote:

Basic info

Kernel: N/A
System: NixOS (Any Version)
Nix version: nix-env (Nix) 1.11.2
Nixpkgs version: 16.09pre79463.d88ae10

Describe your issue here
Installing OpenJDK on NixOS pulls in X11 libraries even when the system is
a GUI-less server. This results in unnecessary dependencies, as any package
that depends on a JDK will cause OpenJDK to be installed, which will in
turn cause the X11 libraries to be pulled in, which will in turn cause the
dependencies of the X11 libraries to be pulled in and so on and so forth.
The unnecessary dependencies are installed regardless of if the program
that depends on the JDK uses the Java GUI libraries.
Expected result
X11 libraries and their dependencies are only installed if the system has
GUI functionality enabled.
Actual result
X11 libraries and their dependencies are always installed.
Steps to reproduce
Install any package on NixOS that depends on a JDK.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub
https://github.com/NixOS/nixpkgs/issues/14345

Might also be relevant to #12877

triage: I can reproduce this still:
 ~> nix-store -q --tree /nix/store/i1b9s1fxb4v339q4dprjdb3rl1wlsfji-openjdk-8u172b11 | grep -i x11
+---/nix/store/adljsy5qhiv543iaivkn0qrryiwjmnff-libX11-1.6.5

Is there a sensible way to solve this?

There is e.g. jdk8_headless since #65247


Fix windows compilation

Fixes compilation on windows machines.

Fixes compilation on windows machines.

NetBSD is experiencing a similar issue too.


Removal of VMA_STATIC_VULKAN_FUNCTIONS.

954631a
This was useful for libraries that depended on other libraries linking with Vulkan.  With VMA_STATIC_VULKAN_FUNCTIONS set to 0 it was possible to call passthrough functions to Vulkan, but not link to Vulkan directly.

If you find this useful then OK, I restored VMA_STATIC_VULKAN_FUNCTIONS macro and also added new VMA_DYNAMIC_VULKAN_FUNCTIONS, all implemented in a new way. Please let me know if it works for you.


Visual Studio 2019

when I open solution generated from cmake with visual studio 2019 (even generated for 2017 version) I lost every file and solution into IDE

thanks

Closing as per discussion on Discord.


Google account login pop up not working

BEFORE YOU BEGIN
I have attempted the following troubleshooting suggestions:

[] The issue persists when using Firefox in Troubleshoot Mode.
[?] Disabled DNS-level content blocking (AdGuard Home, NextDNS, Control D, RethinkDNS, PiHole, etc), cleared my DNS cache, and used my ISP's DNS resolver (if applicable).
[x] Cleared website data, restarted Firefox, and my issue persists.
[x] I have created a new profile. The issue persists when using the current user.js file on GitHub. (Must be in a new profile and a new user.js!)

REPORT
Describe the bug
A clear and concise description of what the bug is.
I have tried to add the site on the exceptions manager and it doesn't do anything. Facebook works but Google doesn't, for some reason
To Reproduce
Steps to reproduce the behavior:
1. Go to 'https://www.duolingo.com/?isLoggingIn=true'
2. Click on 'the google icon'
3. See error

Expected behavior
A clear and concise description of what you expected to happen.
Pop up of the account login showing up.
Desktop (please complete the following information):

OS:Linux
Browser:Firefox
Version:Latest

You indicated that the issue doesn't persist in Troubleshoot Mode, meaning it is likely an extension causing the behavior. Have you ruled those out?


[OSDEV-1169] allow deploying database anonymizer to production

This will allow us to create a copy of the database with anonymized data every Saturday.

@vladsha-dev
Done


Incorporate New Support Annotations

Android Studio added support for special annotations such as @NonNull and @StringRes.  These are especially useful for libraries.  Should update entire library with them.
Ref: http://tools.android.com/tech-docs/support-annotations

Support annotations added to library only.  Demo app left alone. Also updated gradle.


Fix tool tab

Related issue: https://github.com/ga4gh/dockstore/issues/366
Fixed bug in tool tab webservice :

will not create json when tools are missing, this will let gui show warning

dockerEnv separated from defaultDockerEnv

[x] Check that you pass the basic style checks and unit tests by running mvn clean install

Coverage increased (+62.6%) to 73.514% when pulling cb9d242d79cea0c1bb8dd73476e52e7ad2011853 on fix_tool_tab into 263d3fb229f45103de7244cd8cfbc69cfbb7e55b on develop.


Complex MERGE causes crash

I found a bug using my cypher fuzzer.
When running the following query against an empty database:
MERGE n0 = (:A)-[:B{n1:0}]->(x:C)-[:D]->(x)-[:E]->(x)<-[:F{n2:0}]-(:G{n3:0})-[:H{n4:0}]->(y:I{n5:0})<-[:J]-(y)<-[:K]-(:L{n6:0})

The postgres instance crashes and goes into recovery mode.
I encountered this issue when testing queries against the apache/age:PG13_latest docker image.
Steps to reproduce
Spin up a local instance of apache/age:PG13_latest: docker run -e POSTGRES_PASSWORD=123 --rm --name age apache/age:PG13_latest
Get a shell in the docker container: docker exec -it age /bin/bash
Connect to postgres: su postgres -c psql
Run the following queries:
LOAD 'age';
-
SET search_path = ag_catalog, "$user", public;
-
SELECT create_graph('graph');
-
SELECT * FROM cypher('graph',$$
    MERGE n0 = (:A)-[:B{n1:0}]->(x:C)-[:D]->(x)-[:E]->(x)<-[:F{n2:0}]-(:G{n3:0})-[:H{n4:0}]->(y:I{n5:0})<-[:J]-(y)<-[:K]-(:L{n6:0})
$$) as (v agtype);

Expected behavior
The query should run successfully
Actual behavior
The database crashes

gdb stacktrace:
#0  0x00007f158d9c2d16 in epoll_wait (epfd=4, events=0x5576629cb6b0,
    maxevents=1, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
#1  0x00005576618ce67c in WaitEventSetWait ()
#2  0x00005576617cae30 in secure_read ()
#3  0x00005576617d2947 in ?? ()
#4  0x00005576617d37e5 in pq_getbyte ()
#5  0x00005576618f1579 in PostgresMain ()
#6  0x00005576618794a5 in ?? ()
#7  0x000055766187a3f4 in PostmasterMain ()
#8  0x00005576615fc046 in main ()

@DominicWuest Actually, I take that back. I was able to get it to crash.

@jrgemignani @DominicWuest I am currently on the latest commit and I cannot get this to crash

postgres=# SELECT * FROM cypher('test', $$
       MERGE n0 = (x)-[:A]->(x)-[:B]->(x)-[:C]->(x)
 $$) AS (res agtype);
WARNING:  problem in alloc set ExecutorState: bad single-chunk 0x560be8f472b0 in block 0x560be8f3e5c0
WARNING:  problem in alloc set ExecutorState: detected write past chunk end in block 0x560be8f3e5c0, chunk 0x560be8f472b0
WARNING:  problem in alloc set ExecutorState: found inconsistent memory block 0x560be8f3e5c0
WARNING:  problem in alloc set ExecutorState: bad single-chunk 0x560be8f472b0 in block 0x560be8f3e5c0
WARNING:  problem in alloc set ExecutorState: detected write past chunk end in block 0x560be8f3e5c0, chunk 0x560be8f472b0
WARNING:  problem in alloc set ExecutorState: found inconsistent memory block 0x560be8f3e5c0
 res
-----
(0 rows)

postgres=# SELECT * FROM cypher('test', $$
             MERGE n0 = (:A)-[:B{n1:0}]->(x)-[:D]->(x)-[:E]->(x)<-[:F{n2:0}]-(:G{n3:0})
  $$) AS (res agtype);

server closed the connection unexpectedly
	This probably means the server terminated abnormally
	before or while processing the request.
The connection to the server was lost. Attempting reset: Failed.

Here is a slightly less complicated command that exhibits both errors -
psql-11.5-5432-pgsql=# SELECT * FROM cypher('test', $$ MERGE ()-[:B]->(x:C)-[:E]->(x:C)<-[f:F]-(y:I) $$) as (r agtype);
WARNING:  problem in alloc set ExecutorState: detected write past chunk end in block 0x136b500, chunk 0x1378f48
WARNING:  problem in alloc set ExecutorState: bad single-chunk 0x1378fe0 in block 0x136b500
server closed the connection unexpectedly
        This probably means the server terminated abnormally
        before or while processing the request.
The connection to the server was lost. Attempting reset: Failed.
!>

It appears that this MERGE bug has to do with memory allocation. It seems likely that the successive tuple creates aren't properly allocating tuples.

I have created PR #957 to address some of these crashes. It won't address all of them, but it will help to isolate the ones that remain. Basically, there are multiple paths for some of these complex MERGEs to cause a crash, this PR addresses some of those paths.

PR #961 addresses the source of this crash.