Incorrect routing information cause the routing-related  function unavailable

There is a need to add or delete routing information at any time in our business , so I used the RouteDefinitionWriter class to write the code for publishing and deleting routing information.
But if there are wrong parameters in the request, from this time onwards, the routing-related functions are not available, and the same error will be reported all the time.
e.g.
When I submit with the following parameters
{"id":"read","predicates":[{"name":"Path1","args":{"_genkey_0":"/babel/v1/record/**"}}],"filters":[{"name":"RewritePath","args":{"regexp":"/babel/(?.*)","replacement":"/${segment}"}}],"uri":"lb://babel-read_test","order":0}
The program reports the following error
Caused by: java.lang.IllegalArgumentException: Unable to find RoutePredicateFactory with name Path1
But even if I modify the parameters correctly , change  "Path1" to "Path" ,like below
{"id":"read","predicates":[{"name":"Path1","args":{"_genkey_0":"/babel/v1/record/**"}}],"filters":[{"name":"RewritePath","args":{"regexp":"/babel/(?.*)","replacement":"/${segment}"}}],"uri":"lb://babel-read_test","order":0}
It will reports the same error，just like it stays in the state when the first error was reported
I guess it is caused by the use of Reactor framework
My project is base on srping-boot version 2.1.9.RELEASE and spring-cloud.version Greenwich.SR3
and the code is as follows
Contorller
`
@RestController
@RequestMapping("/route")
public class RouteController {
private static final Logger logger = LoggerFactory.getLogger(RouteController.class);

@Autowired
private DynamicRouteServiceImpl dynamicRouteService;

/**
 * 增加路由
 *
 * @param gwdefinition
 * @return
 */
@PostMapping("/add")
public Result<String> add(@RequestBody GatewayRouteDefinition gwdefinition) {
    return this.dynamicRouteService.add(gwdefinition);
}

}
Service
@Service
public class DynamicRouteServiceImpl implements ApplicationEventPublisherAware {
private static final Logger logger = LoggerFactory.getLogger(DynamicRouteServiceImpl.class);
@Autowired
private RouteDefinitionWriter routeDefinitionWriter;

/**
 * 增加路由
 *
 * @param gwdefinition
 * @return
 */
public Result<String> add(GatewayRouteDefinition gwdefinition) {
    try {
        RouteDefinition definition = assembleRouteDefinition(gwdefinition);
        routeDefinitionWriter.save(Mono.just(definition)).subscribe();
        this.publisher.publishEvent(new RefreshRoutesEvent(this));

        return ResultUtil.success(GatewayResultEnum.ADD_ROUTE_SUCCESS);
    } catch (RouteErrorException e) {
        logger.error("添加路由失败 definition:{}", JSON.toJSONString(gwdefinition), e);
        return ResultUtil.fail(e.getMessage(), JSON.toJSONString(gwdefinition));
    } catch (Exception e) {
        logger.error("添加路由失败 definition:{}", JSON.toJSONString(gwdefinition), e);
        return ResultUtil.fail("未知错误");
    }
}

/**
* 将自定义路由组装为springcloud路由
*
* @param gwdefinition
* @return
*/
private RouteDefinition assembleRouteDefinition(GatewayRouteDefinition gwdefinition) throws Exception {
    RouteDefinition definition = new RouteDefinition();

    // ID
    definition.setId(gwdefinition.getId());

    // Predicates
    List<PredicateDefinition> pdList = new ArrayList<>();
    for (GatewayPredicateDefinition gpDefinition : gwdefinition.getPredicates()) {
        PredicateDefinition predicate = new PredicateDefinition();
        predicate.setArgs(gpDefinition.getArgs());
        predicate.setName(gpDefinition.getName());
        pdList.add(predicate);
    }
    definition.setPredicates(pdList);

    // Filters
    List<FilterDefinition> fdList = new ArrayList<>();
    for (GatewayFilterDefinition gfDefinition : gwdefinition.getFilters()) {
        FilterDefinition filter = new FilterDefinition();
        filter.setArgs(gfDefinition.getArgs());
        filter.setName(gfDefinition.getName());
        fdList.add(filter);
    }
    definition.setFilters(fdList);

    // Order
    definition.setOrder(gwdefinition.getOrder());

    return definition;
}

}
entities
@Data
public class GatewayRouteDefinition {
/**
 * 路由的Id
 */
private String id;

/**
 * 路由断言集合配置
 */
private List<GatewayPredicateDefinition> predicates = new ArrayList<>();

/**
 * 路由过滤器集合配置
 */
private List<GatewayFilterDefinition> filters = new ArrayList<>();

/**
 * 路由规则转发的目标uri
 */
private String uri;

/**
 * 路由执行的顺序
 */
private int order = 0;

/**
 * 路由状态 2 删除；1 启用
 */
private int status;

}
`
`
public class GatewayPredicateDefinition {
/**
 * 断言对应的Name
 */
private String name;

/**
 * 配置的断言规则
 */
private Map<String, String> args = new LinkedHashMap<>();

public String getName() {
    return name;
}

public void setName(String name) {
    this.name = name;
}

public Map<String, String> getArgs() {
    return args;
}

public void setArgs(Map<String, String> args) {
    this.args = args;
}

}
`
`
public class GatewayFilterDefinition {
/**
 * Filter Name
 */
private String name;

/**
 * 对应的路由规则
 */
private Map<String, String> args = new LinkedHashMap<>();

public String getName() {
    return name;
}

public void setName(String name) {
    this.name = name;
}

public Map<String, String> getArgs() {
    return args;
}

public void setArgs(Map<String, String> args) {
    this.args = args;
}

}
`

Please update to Hoxton.SR8 and try again as I think there was a fix for this.

It works,I can add routing information by modifying the parameters.
But the CachingRouteLocator class only records the error message, and does not throw an exception.So the call always returns a success message,the callers will not know their parameters are wrong. Only the service provider can find the error message by viewing the log.
CachingRouteLocator
private void handleRefreshError(Throwable throwable) { 		if (log.isErrorEnabled()) { 			log.error("Refresh routes error !!!", throwable); 		} 		applicationEventPublisher 				.publishEvent(new RefreshRoutesResultEvent(this, throwable)); 	}

Please update to Hoxton.SR8 and try again as I think there was a fix for this.

It works,I can add routing information by modifying the parameters.
But the CachingRouteLocator class only records the error message, and does not throw an exception.So the call always returns a success message,the callers will not know their parameters are wrong. Only the service provider can find the error message by viewing the log.
CachingRouteLocator
private void handleRefreshError(Throwable throwable) { if (log.isErrorEnabled()) { log.error("Refresh routes error !!!", throwable); } applicationEventPublisher .publishEvent(new RefreshRoutesResultEvent(this, throwable)); }

This is on purpose so the gateway would continue to function in the event of bad configuration during an update.

If so, can I only provide a query interface to let the caller know whether the routing information they submitted is registered in the gateway?

/actuator/gateway/routes

Yes, I know this interface.So I need to expose it to the caller of the routing registration interface to let them query the routing information whether the registration is successful?

That endpoint uses the RouteLocator bean.


Add PyPI trove classifiers for Wagtail

I added a new documentation section "Developing packages for Wagtail". This section contains PyPI trove classifiers for Wagtail and link to https://github.com/springload/awesome-wagtail.
Closes #4483

Rebased and merged in 6d79169dadc810cbdf71e7eb11c2c46695f8f099.
Thanks Fedor!


Unhandled method client/registerCapability

Hi,
I know there has been the same issue before just a few months back which was closed by the reporter.
But although following his advice and using the latest versions of all related/necessary packages, I still get this response from the language client when the server requests to register capabilities:
{"jsonrpc":"2.0","id":225,"error":{"code":-32601,"message":"Unhandled method client/registerCapability"}}
I tried to debug and it seems like there is no handler registered for that request within vscode-jsonrpc.
This is the request from the server (I am connected to the Omnisharp language server):
{"jsonrpc":"2.0","id":228,"method":"client/registerCapability","params":{"registrations":[{"id":"797c4c87-a2a7-420f-9319-af8a3c7bcea7","method":"textDocument/completion","registerOptions":{"triggerCharacters":["."],"resolveProvider":false,"documentSelector":[{"pattern":"**/*.cs"}]}}]}}
Any suggestions to solve this?
I can add any files needed to this ticket in order to get a solution, but just don't want to overload it right now.
Many thanks!

I tried to dig through the code a bit and it looks like when creating the client I need to call onRequest() to register certain request handlers? (IConnection). I have not yet been able to find any place withing this code base where this happens.
Would this be the editors responsibility? So am I missing a link between the client and the monaco editor?

I got a step further.
Seems like I did a breaking change on the server side when I was figuring out the communication issues I had and then decided to implement my own input and output handlers in the omnisharp language server using Observable and Observer instead of streams.
I just reverted that one particular change and the exchanged message look a lot better.
However after both sides report 'initialized' they basically stop talking to each other.
When typing into the editor or triggering AutoComplete ("No Suggestions") no messages are being sent to the server.
Any ideas?

I got to a point now where server and client successfully initialize and the client is sending regular requests.
Unfortunately in the server, there is no document to synchronize with and therefore also no suggestions for auto complete etc.
I believe the client would need to send an openDocument notification in order for the server to actually create that document and synchronize.
Just need to figure out  how to do this, I noticed the request() method on the client, so that will be my entry point.
I'd very much appreciate any suggestions.
Thanks very much!

Got it solved.
Was essentially how I configured the initialize request.


How to check success for dm control tasks?

Does anyone know that how to check if the task is success or not when an episode ends?

Did you determine whether the goal was successfully reached then? How did you do it?


Autosave should accept callbacks

I'm submitting a...

[ ] Bug report
[x] Feature request

Description
It would be great to have a way of changing autosave's behavior. like for example to make it persist data to an API.

Agree, would be glad to accept a PR. It should not be to hard to implement.

Awesome! I can work on this.
I'm thinking of adding an extra configuration option to autosave, something like action.
Any thoughts or suggestions?

Added with #13


RS: Verify international standing order mandatory APIs is implemented

Description

Verify the implementation of international standing orders API on RS backend
Spec: https://openbankinguk.github.io/read-write-api-site3/v3.1.8/resources-and-data-models/pisp/international-standing-orders.html
Repository: securebanking-openbanking-uk-rs
Verify if the international standing orders APIs are implemented in the RS Discovery
Verify headers

We are aware that the optional GET /international-standing-orders/{InternationalStandingOrderPaymentId}/payment-details isn't implemented yet so that we create an issue (#471) to do the implementation.

Acceptance criteria

[ ] The International standing order APIs are implemented. (except GET /international-standing-orders/{InternationalStandingOrderPaymentId}/payment-details )

Hey team! Please add your planning poker estimate with Zenhub @frlaura-jianu @mariantiris


ARROW-9941: [Python] Better string representation for extension types

See: https://issues.apache.org/jira/browse/ARROW-9941
Before:
>>> ty
IntegerType(extension<arrow.py_extension_type>)
>>> str(ty)
'extension<arrow.py_extension_type>'
>>> repr(ty)
'IntegerType(extension<arrow.py_extension_type>)'
>>> pa.DataType.__str__(ty)
'extension<arrow.py_extension_type>'

After:
>>> ty
IntegerType(DataType(int64))
>>> str(ty)
'extension<arrow.py_extension_type<IntegerType>>'
>>> repr(ty)
'IntegerType(DataType(int64))'
>>> pa.DataType.__str__(ty)
'extension<arrow.py_extension_type<IntegerType>>'

The problem is that this won't be visible from C++ code, which will still get extension<arrow.py_extension_type>.
>>> ty
IntegerType(DataType(int64))
>>> pa.DataType.__str__(ty)
'extension<arrow.py_extension_type>'

Solving this requires some collaboration with the C++ side.  I advise you to take a look at cpp/src/arrow/python/extension_type.h. You'll probably need to override the ToString method in arrow::py::PyExtensionType. By default it can return the same as ExtensionType::ToString, but it can also query a Python attribute on type_instance to get a custom string.

@pitrou Thanks for the feedback! I figured it must be more involved than this ;) I'll see if I can figure out the C++ side later today.

If I do something like the following & revert the Python changes, I get this result.
// cpp/src/arrow/python/extension_type.cc
std::string PyExtensionType::ToString() const {
  return this->storage_type()->ToString();
}

// cpp/src/arrow/python/extension_type.h
std::string ToString() const override;

>>> ty = IntegerType()
>>> ty
IntegerType(int64)
>>> pa.DataType.__str__(ty)
'int64'

And if I keep the Python changes & the C++ changes, I see this:
>>> ty = IntegerType()
>>> ty
IntegerType(DataType(int64))
>>> pa.DataType.__str__(ty)
'int64'

What are the desired return values?
PS. I don't want to take up too much of your time. I won't be offended if you decide it's quicker to just implement this yourself. That, and I don't know C++, so anything I do attempt should be heavily scrutinized ;)
Thanks again for taking the time to review my first attempt and pointing me in the right direction.

I amended the commit to return this:
assert pa.DataType.__str__(ty) == "arrow.py_extension_type<int64>"

assert pa.DataType.__str__(ty) == "arrow.py_extension_type<int64>"

The problem is that this doesn't distinguish between different extension types with the same storage type. For example, two extension types representing UUIDs and IPv6 addresses, respectively, would get the same string representation (because both would be backed by a 16-byte fixed-size binary).
I would be more useful if the string representation looked like extension<arrow.py_extension_type<IntegerType>>, where IntegerType is the Python class name.
Optionally this could be made configurable as well.

To be clear, the 2 Windows CI failures are unrelated.

I had hoped I could just use something like the following, but it's segfaulting. I think I need to go back to first principals and do a few C++ tutorials ;)
internal::PyObject_StdStringRepr(type_instance_.obj());

I have it returning "extension<arrow.py_extension_type<IntegerType>>" now from the C++ side.
No idea if it's right though.
Thanks for your patience :)

Late comment on this PR: for the PyExtensionType subclasses, this is certainly a nice enhancement. But for custom extension types directly subclassing ExtesionType, this might not be needed. Using the PeriodType class from the tests, we now have:
In [26]: period_type = PeriodType('D')

In [27]: period_type
Out[27]: PeriodType(DataType(int64))

In [28]: str(period_type)
Out[28]: 'extension<test.period<PeriodType>>'

while before this was:
In [2]: period_type = PeriodType('D')

In [3]: period_type
Out[3]: PeriodType(extension<test.period>)

In [4]: str(period_type)
Out[4]: 'extension<test.period>'

Since here, the extension name is already unique and not the generic "arrow.py_extension_type", adding the class name to __str__ seems to not add much value / give only a longer type name?
For the __repr__ I am less certain about (showing the storage type is also useful), but I think also showing the identifier name of the extension type can be useful.
(happy to work on this if there is agreement to change this)

That would sound ok to me.


Control panel deploy contract to a single user flow

Is your feature request related to a problem? Please describe.
v2 Playground mvp needs to have functionality to deploy contracts to users.
Describe the solution you'd like

add feature to control panel component to show label to indicate you can choose one user to send.
scenario 1: if user is deploying to one account and has one account selected in the control panel, label will read deploying to 1 of 1 account(s)
scenario 2:if user is deploying to three accounts and has two accounts selected in the control panel, label will read deploying to 2 of 3 account(s)

todo ask @srinjoyc about multiple account contract deployment priority

Duplicate of another ticket that has been completed - @fotescodev to find the ticket and reference


[1.30.0] Rename ES6 object-property inside method-parameter not working

After updating Vs Code to 1.30.0 renaming objects-properties used as method-parameters in an ES6 class don't rename as they should.

VSCode Version: 1.30.0
OS Version: Windows 10

Steps to Reproduce:

Have a class with an object as param
Rename one property of that object

Does this issue occur when all extensions are disabled?: Yes

I don't think this is a bug - we rename the name used within the class, but not the name used outside of it, since that's a separate symbol (though a destructuring operation ties them together).

Like, this is so intentional that it's listed as a feature on the release announcement: https://code.visualstudio.com/updates/v1_30#_renames-handle-jsts-destructuring-properly

Yes this is a bug. It's unwanted behaviour and it's doing something completely different then renaming. Look at the video in my post. This is not renaming, this is adding something and changing a structure into something we don't want in Javascript and doesn't work.
The link you sent is clearly a different situation; that's about interfaces. Next to that renaming looks to work on that example, but isn't in this situation in 1.30.0.
This is how it was working in 1.29.1 and is suppose to work:

Still happening in 1.30.1. Any news on this?

Dupe of #29238?

@Friksel - Looks like this PR will be included in TypeScript 3.4 which should be out in a month or two.

Thanks for the updates guys @justingrant @weswigham . Great it's changing!

@justingrant  I see the PR you are talking about is merged to master a while ago and this issue is closed, but in version 1.36.1 the result I get is still exactly the same as when I opened this issue, so so far I don't see any change.
Do I perhaps need to change some setting to make this work as expected?

@justingrant  I see the PR you are talking about is merged to master a while ago and this issue is closed, but in version 1.36.1 the result I get is still exactly the same as when I opened this issue, so so far I don't see any change.
Do I perhaps need to change some setting to make this work as expected?
[edit] Ah, my bad. I just in the commit message of the PR a setting has indeed been added. For future reference for people having the same issue:

Via Settings UI: The setting is called Javascript --> Preferences --> Rename Shorthand Properties in the UI and if you remove the tick it's working as expected in Javascript.
Via settings.json: Or just add "javascript.preferences.renameShorthandProperties": false to the settings.json


Feedback from 3.0.0 alpha versions

This issue is to get feedback from the 3.0.0 alpha versions.
If you have any questions or remarks, about this release, let us know!
Best,
Alexandre

Will you provide DX 11.2 binaries for .Net 4.5 via nuget?

@QuantumDeveloper Hm, not sure about which DX11.2 binaries you are referring? D3D11 D3D11.1 D3D11.2 are now all accessible from a single D3D11 assembly.

Ah, its good. I remember that earlier D3D11.2 must be built separately as build target DirectX 11_2.

@QuantumDeveloper yes and that was a pain to maintain, build and package. That's one of a big change in 3.0.0

Its good change I think)

@xoofx Also do you plan to enable SIMD support for math (vectors, matrices)?

@xoofx Also do you plan to enable SIMD support for math (vectors, matrices)?

As SIMD support is quite orthogonal to SharpDX if you prefer to use System.Numerics.Vectors instead of SharpDX.Mathematics, it is up to your project. There is currently no plan to migrate SharpDX.Mathematics to System.Numerics.Vectors.

Thanks for your hard work on this release. I'm really happy about the basic interop types. Trying to develop a basic engine/framework ontop of SharpDX while trying to encapsulate SharpDX data types was a strange thing.

Thanks for your continuous work on SharpDX!
Will the Toolkit be updated to compile with the latest changes?

Will the Toolkit be updated to compile with the latest changes?

Unfortunately, no, the Toolkit is deprecated and no longer supported, as I'm focusing on Paradox now. But if someone wants to fix it, pull requests are welcome.

Wanted to say thank you to @xoofx for his continued work on SharpDX which is a great boon for C# and Direct3D hackers.

Maths classes were meant to be in Mathematics, but the alpha has moved them all back to SharpDX, under the old 3.0.0 they were already in SharpDX.Mathematics.

Maths classes were meant to be in Mathematics, but the alpha has moved them all back to SharpDX, under the old 3.0.0 they were already in SharpDX.Mathematics.

Yeah, sorry, It was breaking too many samples and wanted to avoid this burden for existing users as well, so I reverted it back to the root namespace. If you look at existing code base, when there was a using SharpDX; it was only used to include Mathematics and just the Utilities class, so it is fine to let it as it is today. As the SharpDX namespace is a bit less cluttered it should be fine. Also the SharpDX.Mathematics assembly is optional, so it doesn't force to use it.

ok.
Also want to say that i really like the simplicity of having desktop & store versions. It must be a lot easier to maintain. And thanks for the DX12 preview. I probably won't look at it myself for a few months, because my current project is undergoing enough twists and turns as it is, but looking forward to eventually taking a peek. Thanks for all your hard work.

I just converted to using the alpha binaries.
The alpha version seems to be throwing and catching many System.Exception's internally, I think its slowing down my application. Any standard Direct3D11 call is causing it, i.e. SwapChain.ResizeBuffers, and even the SharpDX.Direct3D11.Device constructor.
I am using the Release/Retail compiled SharpDX alpha assemblies always. When compiling my project under Debug it lags, only while the debugger is attached, otherwise it is fine (i.e. running the Debug executable outside of visual studio is OK). Running the project in release mode is also fine.
Visual studio only detects System.Exception's while running in Debug mode for my project.
Its really odd, I'm still not 100% certain it has something to do with SharpDX. I have however reverted back to the 2.6.3 assemblies to test and the problem is fixed (no System.Exception's detected anywhere).

@xanather I have clone the Samples repo and downloaded the zip with 3.0.0-alpha01, and samples are working without any exceptions, so it must be something wrong in your setup. If you still have an issue, open a new issue so that we will discuss specifically from there.

Thanks for testing that, given the samples don't show anything I will investigate more on my side before deciding if I should setup an issue.

I don't know where this issue lies, but please take a look, as i can't pin it down, and it's starting to look like the problem doesn't lie with the xaml rendering call.
https://social.msdn.microsoft.com/Forums/windowsapps/en-US/34848738-61ec-4af5-b46e-b0b6fda6c58a/cant-prevent-multiple-threads-from-calling-directx?forum=winappswithcsharp

I just read on the SharpDX news page that Direct3D10 APIs have been removed from v3.0. Is there any specific reason as to why? My media player relies on D3D9, 10 and 11 and in the near future I plan to support D3D12 as well. How would I go about doing this with SharpDX v3.0? Would it be possible to use v3.0 alongside v2.6.3? I can't drop D3D10 support as there are old cards out there that is still perfectly capable of playing video that don't have D3D11 and requires D3D10's exclusive mode for 10/16-bit output.

@zachsaw, HW supported by d3d10 is also supported by d3d11 (this is called HW feature level, a reason why you can use d3d11 api on a mobile phone with a 9.3 GPU) so afaik There is no reason to support d3d10 (only reason would be for d3d10/d2d interop on older win7 OS)

@xoofx, Ah I see, so you'd just use d3d11 API and request for feature_level_10? What about the Font APIs of d3d10?

@xoofx Does effects framework also available for DX12 in sharpdx?

The effects framework was depreciated in Direct3D11. I assume it doesn't exist in Direct3D12 meaning SharpDX can't provide it.

@xanather really? then what effects do in direct3d11_2 ddls of sharpdx?

@xoofx
On the SharpDX homepage is written:
"All Mathematics (Vector3, Vector4...) have been moved to a dedicated assembly. The reason behind this change is to put SharpDX on a diet, where higher level API (like Paradox, MonoGame...) are no longer forced to include this API. In order to support this, all SharpDX assemblies are now using interop types (RawVector3, RawVector4 from SharpDX.Mathematics.Interop namespace)"
I really want to continue using the classes from SharpDX.Mathematics assembly, because our SkinEngine makes havy use of calculation with RectangleF, SizeF, Matrix etc. for layouting.
How it is supposed to use SharpDX3 Raw* types in combination with the classes from Mathematics assembly? Are there any conversion routines available?
I already tried to workaround with creation of extension methods for RectangleF, but once I get to D2D custom effects which require RawMatrix while all calculations do use Matrix, the situation is very bad.
Any guidance for a v3 migration of our project is very appreciated!
(I hope to solve compatibility issues with Direct2D1 and Windows 10)

The SharpDX math/geometry types should be able to implicitly convert to its respective raw type:
https://github.com/sharpdx/SharpDX/blob/master/Source/SharpDX.Mathematics/Vector3.cs#L1808
https://github.com/sharpdx/SharpDX/blob/master/Source/SharpDX.Mathematics/Color.cs#L1058
https://github.com/sharpdx/SharpDX/blob/master/Source/SharpDX.Mathematics/Point.cs#L144
For example, just provide a Point type if it asks for a RawPoint (or any other type for that matter).

@morpheusxx for D2D effects, the latest 3.0 version is not yet working, so it will change slightly the declaration of the custom attribute on the field, but than after it will work directly without changing the types for the field (you will be able to keep Matrix/Vector...etc.)

Thanks for the continued versions of SharpDX!
I've been using SharpDX 2.x to enable DirectCompute in .NET.  I understand the toolkit will not move to 3.0, but really liked the GetData and SetData functions in the toolkit for structured,raw,and constant buffers.  I see that it is very easy to create initialized buffers in SharpDX 3.0 by passing in a typed array (or structure for constant buffers) into Buffer.Create().  Are there plans to extend that ease with generic GetData and SetData functions?
Also I notice there is support for vector234, and half234.  Is it possible to add support for double234?

Also just tried version <IP_ADDRESS>, and like zachsaw found Direct3D10 missing. I am writing a Direct2D accelerated control for a WPF application targeted at Windows 7 – 10.
Couple of questions, forgive me if they are simple, but I am not familiar with the interop between various DirectX releases.
@xoofx Can I support Direct2d using Direct3D11 on Windows 7 – 10? Or is Direct3D10 a must for Windows 7? Will it be possible for me to move to <IP_ADDRESS> and continue supporting Windows 7 – 10 with my Direct2D control?
Thanks for your time.

@chedburgh Direct3D11 works on vista and higher, i suppose that's why not many use Direct3D10 anymore since Direct3D10 also works on vista only or higher. Same requirements just Direct3D11 is newer and more evolved. Most GPU's that support Direct3D10 also support Direct3D11. Not sure about what Direct2D needs to use underneath though.

@chedburgh Direct2D should work with Direct3D11 with Windows 7 platform update installed. But I'm not sure this platform update is installed automatically, so maybe I will consider to re-introduce Direct3D10 assembly.

Thanks both for the answers.
@xanather I am not sure either. I currently have Direct2D working with the Direct3D10/D3DImage fine for my needs (finally!), and I'm not sure on the requirements to move it to Direct3D11. Something for me to investigate later.
@xoofx Thanks for considering it. I'll keep an eye on the commits/news/twitter feed and move across to help testing <IP_ADDRESS> if I see it reintroduced.

Hi Guys, I have been playing around with Direct3D12 and have some problems to report if someone is interested.

@bdachev sure, open a dedicated issue for this

OK. I will open dedicated issue for each problem I find. In general I started doing my tests before SharpDX 3.0 alpha2 was published so I had to manually patch the SharpDX source code to compile against newer Windows 10 SDK. I also use here Visual Studio 2015 RC and probably my patches won't work directly for you.

Just for the record after pulling the latest from master and compiling it here it seems the problems I was having are already resolved. There were some alignment issues due to pointers in structures but it is OK now for both x86 and x64 configurations.

I've been experimenting with using SharpDX 3 in a CoreCLR project and I've discovered that there is no option in a Visual Studio 2015 CoreCLR project to enable native code debugging. Are there any other ways around this that you're aware of? Or are we a bit dead in the water in this regard?

@axefrog Are you using DNX? Maybe its something to post about here https://github.com/aspnet/DNX as it's not really related to SharpDX.

@xanather I'm using VS2015 as the issue relates to me not being able to see DX debug messages in the debug output panel. I've had a huge amount of trouble finding anyone who can provide a canonical answer on this, but I am beginning to suspect that you're probably right; it may simply be too early in CoreCLR's development cycle.

Just thought I'd leave this here now that I finally have an answer. If you're trying to use SharpDX 3 in one of the new VS2015 .Net Core projects (with the project.json file, dnx and all of that stuff), you can still debug and get native Direct3D debug messages. This StackOverflow question has the details. http://stackoverflow.com/questions/31558596/no-native-code-debugging-in-coreclr-console-application-projects-in-vs2015

Hi, I'm using SharpDx D3D12 to prepare a set of tutorials (I'm actually experimenting it to learn as much as possible).
Except for one bug (I've added a pull request for ResorceDescription) it works great.
Just missing some utilities (like loading resource from file, I'm writing a method to load dds)  and DescriptorRange array inside DescriptorParameter. For now I'm doing this way
DescriptorRange[] ranges = ...
.............
desc= new RootDescriptorTable()
    {
    DescriptorRangeCount = ranges.Length,
    PDescriptorRanges = Marshal.UnsafeAddrOfPinnedArrayElement(ranges, 0)
}

Any prevision for next release?
Thx

@RobyDX I have been busy recently, hopefully I will have a look to upgrade Direct3D12 next week.

That's will be great. If you need some help, ask me.
I'm really interested in D3D12 for .Net

@xoofx
Thanks for all your hard work!
I'm using Direct2D (from F#) and just did a trial run update to 3.0.0 (beta1). (
First up, all the implict conversions don't work in F#, so that's a little bit painful, but can be resolved with some f# extension methods such as (some random examples, covering some different cases):
[<AutoOpen>]
module ImplicitCoversion =
    let inline (!>) (x:^a) : ^b = ((^a or ^b) : (static member op_Implicit : ^a -> ^b) x)

type SharpDX.Direct2D1.RenderTarget with
    member inline this.DrawLine(v0:Vector2, v1:Vector2, brush) =
        this.DrawLine (!> v0, !> v1, brush)

    member inline this.Transform
        with set (value:Matrix3x2) = this.Transform <- !> value

    member inline this.Clear (color:Color4) =
        this.Clear (Nullable (!> color))

type SharpDX.Direct2D1.SolidColorBrush with
    static member inline Create(renderTarget, color:Color4) = new SolidColorBrush(renderTarget, !> color)

Which seem to work pretty well. Maybe I'll create an exhaustive set at some stage so assist any others using f# - would you want something like that "officially" in your repo (i.e. probably an extra assembly given the f#ness)
But what I couldn't "simply" solve was SimplifiedGeometrySink.AddLines because it takes an array.  Just wondering if you have an magic for casting between array types? (and if so, maybe an extension method could be added for SimplifiedGeometrySink in the SharpDX.Mathematics library?)

I have been working on a force feed back example for a few days now only to find I'm hitting a wall. I just saw this thread and wondered if its why I can not get it working. When I create the effect I get parameter incorrect. I can provide details if needed.


tsp mgmt, fix stuck for some pipelines

fix https://github.com/Azure/autorest.java/issues/2923
cause: https://github.com/Azure/autorest.java/issues/2923#issuecomment-2306541926
pipeline succeeded: https://dev.azure.com/azure-sdk/internal/_build/results?buildId=4075989&view=logs&j=f0ea25ea-b7e0-596e-c691-94ee910ce8e9&t=4036877c-0fde-50d1-2f32-52f8f5ad201b

Does it work?

Does it work?

Yeah, pipeline succeeded for this branch: https://dev.azure.com/azure-sdk/internal/_build/results?buildId=4075989&view=logs&j=f0ea25ea-b7e0-596e-c691-94ee910ce8e9&t=4036877c-0fde-50d1-2f32-52f8f5ad201b


Heavily optimise multithreading

Right now the multithreading could use some heavy optimisations.
Will get right onto it to make this an even better program to use

Solved in #13


Memory footprints

Could you please tell the memory footprints of COTR during traing process? Thanks

For first two stages, we load images into main memory, that’s about 64GB RAM. As for VRAM, that’s around 20GB.


feat(api-client): new settings page

Tasks

[ ] If I change the theme and reload, it’s still the same theme.
[ ] If I uncheck the Scalar Proxy and reload, it’s enabled again.

currently we have no way to toggle the proxy in the scalar app, we are gunna have a settings page with shortcuts and a whole bunch of other things but for the time being we can just have a toggle for our proxy (and i added a theme picker)
https://github.com/user-attachments/assets/814b87dd-7f66-4553-804d-0553d3914302

+1 to @hanspagel comment that the home icon is bad choice. Should be a ⚙.

rebased, fixed and updated with a proposal

The text in the table doesn’t wrap on small screens. We can improve this in a seperate PR, though.

fixed by #2971

ignore this comment, doing some cross browser testing on gh images

Did you hijack this PR to upload assets for the README? 😅

Did you hijack this PR to upload assets for the README? 😅

it's for cross browser testing / mobile testing 😹  + for some reason svg's dont render on mobile in private repos so i just leave comments here and hope no one sees 😬

@amritk do you mind giving a look on saving the state of the proxy option?

@amritk do you mind giving a look on saving the state of the proxy option?

Yep but not until later this week

i set the local storage proxy so should be good to go @amritk @hanspagel

Looks great! Unfortunately, it seems themes aren't correctly loaded/changed. Some colors change, but not the background color for example.

fair catch, that's because of the way client has been brought up to life first, i was thinking of fast follow fixing this but will do in that pr!

latest updates:

fixes route redirection to settings
sets sidebar element action props to prevent display in setting ones
fixes setting view border spotted by @hanspagel
favors color mode over is dark as suggested by @hwkr

Looks like the dark mode setting is loaded on the settings page only. When I refresh on another page it’s using light mode, instead of the system preference (dark).
https://github.com/user-attachments/assets/a0bafaeb-4fe4-45f9-85c8-1eaa0cc78c6c
The sidebar hover effect makes the text disappear, and the active request state has a strange border (theme: moon).

latest updates:

fixes color mode issue on other views caught by @hanspagel
updates border color presets of themes caught by @hanspagel


Output.nix file is not imported or used anywhere

Could it be that the output.nix file is not used anywhere?

Upsi, did not mean to even push that. This was only a test file. The output is now written to pkgs/vim-plugins.nix
Thanks for reporting, anyway :)


[285] Issue with running 'npm run test'

Title:
Issue with running 'npm run test'
Description:
npm run test i'et
Summary:
The customer appears to be facing a technical issue related to the 'npm run test' command. Please investigate if there are syntax issues or dependencies causing the problem. Reach out to the customer for more details if necessary, such as error messages or logs.
Info
Reported by: Guest<EMAIL_ADDRESS>- Open in Gleap
Location: TN
Type: 🚨 BUG
🔗 Open share link
🌍 Open ticket in Gleap
Metadata
browserName: Chrome(131.0.6778.104)
userAgent: Mozilla/5.0 (Linux; Android 9; MRD-LX1F Build/HUAWEIMRD-LX1F; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/131.0.6778.104 Mobile Safari/537.36
browser: Chrome
systemName: Android
sessionDuration: 76
devicePixelRatio: 2
screenWidth: 360
screenHeight: 780
innerWidth: 360
innerHeight: 560
currentUrl: https://docs.near.org/build/smart-contracts/quickstart
language: fr-CA
mobile: true
sdkVersion: 13.7.3
sdkType: javascript
environment: prod

Internal note 📝: The customer appears to be facing a technical issue related to the 'npm run test' command. Please investigate if there are syntax issues or dependencies causing the problem. Reach out to the customer for more details if necessary, such as error messages or logs.


[#143] Add ignored path globs as a config

Starting from this commit, ignored paths are able to be edited using the
extension settings
Not sure how to test this though
Closes #143

@Tadaboody I think just having the integration tests pass for this is good enough as we dont really want to test the glob module. Thanks again for submitting a pull request!

@ryanluker changes were introduced in https://github.com/ryanluker/vscode-coverage-gutters/pull/168/commits/887a9fd2e26cc263f7be8652b9d828cf04999d0f. Awaiting re-review.

@Tadaboody thanks for helping with the extension!


How to quantify ssd_mobilenet_v1_coco model and toco to .tflite ?

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): yes
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Ubuntu 16.04
TensorFlow installed from (source or binary): Source
TensorFlow version (use command below): 1.8.0
Python version:2.7.12
Bazel version (if compiling from source): 0.12.0
CUDA/cuDNN version: cuda-9.0/7.0
GPU model and memory: GeForce GTX 1080/8105MiB
Exact command to reproduce: N/A
Phone: Moto G4 Play (need to use Camera, not Camera2)

Hi,  guys,
I am trying to quantify ssd_mobilenet_v1 using tensorflow object detection api, according to @coutner post .
First, I replace all the graph_hook_fn in
trainer.py tf.contrib.quantize.create_training_graph and enable fused batch norm in ssd_mobilenet_v1_feature_extractor.py
After training, I used the following script to transform the model.

when running optimize_for_inference, some warning had arisen.

$ bazel run -c opt tensorflow/python/tools/optimize_for_inference -- \
>     --input=$DETECT_PB --output=$STRIPPED_PB --frozen_graph=True \
>     --input_names=Preprocessor/sub --output_names=concat,concat_1 \
>     --toco_compatible=True \
>     --alsologtostderr
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/FusedBatchNorm'
WARNING:tensorflow:Didn't find expected Conv2D input to 'FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/FusedBatchNorm'

When Running toco,
$ bazel run tensorflow/contrib/lite/toco:toco --
>   --input_file=$STRIPPED_PB \
>   --output_file=$DETECT_FB \
>   --input_format=TENSORFLOW_GRAPHDEF \
>   --output_format=TFLITE \
>   --inference_type=QUANTIZED_UINT8 \
>   --input_shapes=1,300,300,3 \
>   --input_arrays=Preprocessor/sub \
>   --output_arrays=concat,concat_1 \
>   --std_values=128 \
>   --mean_values=127 \
>   --dump_graphviz=/tmp
2018-04-24 18:51:51.645315: I tensorflow/contrib/lite/toco/graph_transformations/graph_transformations.cc:39] Before Removing unused ops: 253 operators, 450 arrays (0 quantized)
2018-04-24 18:51:51.686011: I tensorflow/contrib/lite/toco/graph_transformations/graph_transformations.cc:39] Before general graph transformations: 253 operators, 450 arrays (0 quantized)
2018-04-24 18:51:51.774563: I tensorflow/contrib/lite/toco/graph_transformations/graph_transformations.cc:39] After general graph transformations pass 1: 62 operators, 169 arrays (1 quantized)
2018-04-24 18:51:51.775525: I tensorflow/contrib/lite/toco/graph_transformations/graph_transformations.cc:39] Before pre-quantization graph transformations: 62 operators, 169 arrays (1 quantized)
2018-04-24 18:51:51.776094: F tensorflow/contrib/lite/toco/tooling_util.cc:1464] Array FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6, which is an input to the DepthwiseConv operator producing the output array FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6, is lacking min/max data,
which is necessary for quantization. Either target a non-quantized output format, or change the input
graph to contain min/max information, or pass --default_ranges_min= and --default_ranges_max= if you
do not care about the accuracy of results.
Aborted (core dumped)

Is there anyone who can help ? @andrewharp ,
thanks.

Can you try --inference_type=FLOAT?

@andrehentz doesn't that disable quantization? I thought the whole point of @WenguoLi 's question was to quantize in tflite...

@MohammadMoradi   hello, I face the same pronlem, "Cannot convert between a TensorFlowLite buffer with 270000 bytes and a ByteBuffer with 1080000 bytes" .  have you solved it ?

@zhyj3038 hello, the problem is that when using float model, you must allocate 4 * 270000 = 1080000 because the float is 32bit and the quantized version of model is 8bit. You must change the input allocated buffer to match your model type.

@MohammadMoradi    thanks very much .   I am not good at java and android , you help me a lot !

@MohammadMoradi @WenguoLi @zhyj3038
Hello all,
I am facing the same problem when I am using inference_type=FLOAT. Do you guys solved the problem?
Where should I change the value for bytebuffer? I am not getting how should one allocate 4*270000 when using float buffer.
Please share your suggestion.
Thank you

@MohammadMoradi @WenguoLi  @zhyj3038
Hello ,
any update on @alokranjan007 problem ?
I am also having the same issue.
Thanks!

@jass-singh    you can not use float, but you must quantize the model.

@zhyj3038 i tried that too using
--inference_type=QUANTIZED_UINT8
but then i am not able to create .tflite  :
2018-08-24 13:16:55.166755: F tensorflow/contrib/lite/toco/tooling_util.cc:1619] Array FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6, which is an input to the DepthwiseConv operator producing the output array FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6, is lacking min/max data, which is necessary for quantization. If accuracy matters, either target a non-quantized output format, or run quantized training with your model from a floating point checkpoint to change the input graph to contain min/max information. If you don't care about accuracy, you can pass --default_ranges_min= and --default_ranges_max= for easy experimentation.
Aborted (core dumped)

I use mobilenet v2

@jass-singh @zhyj3038 Hello,
A fix: I would recommend that you useinference_type=FLOAT for the conversion. However, do change DetectorActivity.java file in the tensorflow/contrib/lite/examples/android/app/src/main/java as below:
private static final boolean TF_OD_API_IS_QUANTIZED = false; (It should be true by default).
After this save your file and try to build the apk. Let me know if it works :)
Cheers!!

@alokranjan007
I did but got error :
Caused by: java.lang.IllegalArgumentException: Cannot convert between a TensorFlowLite buffer with 1080000 bytes and a ByteBuffer with 270000 bytes.
Where should i make changes to handle bytes problem?

@jass-singh Could you share the detailed steps of converting frozen graph into .tflite format. Just want to check if your are following in right direction. Which model you are using?
Thank you

I am using Mobilenet model ssd_mobilenet_v1_coco_2017_11_17 , retraining on faces.

export PYTHONPATH=$PYTHONPATH:pwd:pwd/slim
export CONFIG_FILE=/home/jaskaran/Git_Download_Libraries/face_detection_inference_graph_2018_08_23/pipeline.config
export CHECKPOINT_PATH=/home/jaskaran/Git_Download_Libraries/face_detection_inference_graph_2018_08_23/model.ckpt
export OUTPUT_DIR=/home/jaskaran/Git_Download_Libraries/face_detection_inference_graph_2018_08_23/

Further, creating .pb using pipeline.config,

python object_detection/export_tflite_ssd_graph.py
--pipeline_config_path=$CONFIG_FILE
--trained_checkpoint_prefix=$CHECKPOINT_PATH
--output_directory=$OUTPUT_DIR
--add_postprocessing_op=true

Further, made changes in DetectorActivity.java file in the tensorflow/contrib/lite/examples/android/app/src/main/java as below:
private static final boolean TF_OD_API_IS_QUANTIZED = false;

At last ,

bazel run -c opt tensorflow/contrib/lite/toco:toco --
--input_file=$OUTPUT_DIR/tflite_graph.pb
--output_file=$OUTPUT_DIR/custom_mob_2018_08_23_v2.tflite
--input_shapes=1,300,300,3
--input_arrays=normalized_input_image_tensor
--output_arrays='TFLite_Detection_PostProcess','TFLite_Detection_PostProcess:1','TFLite_Detection_PostProcess:2','TFLite_Detection_PostProcess:3'
--inference_type=FLOAT
--mean_values=128
--std_values=128
--change_concat_input_ranges=false
--allow_custom_ops

@jass-singh Assuming that you have already trained you model and have set the python path. I would suggest to follow below steps for inferncin.
Step 1.
python export_tflite_ssd_graph.py \ --pipeline_config_path=/home/username/tensorflow-master/models/research/object_detection/path to .config file \ --trained_checkpoint_prefix=/home/username/tensorflow-master/models/research/object_detection/path to the trained model ckpt point(your total no of steps after the training) \ --output_directory=/home/username/tensorflow-master/models/research/object_detection/any folder name \ --add_postprocessing_op=true
This will generate tflite_graph.pb file and tflite_graph.pbtxt
Step 2:
bazel run -c opt tensorflow/contrib/lite/toco:toco -- \ --input_file=/home/username/tensorflow-master/models/research/object_detection/customized_model/path to tflite_graph.pb \ --output_file=/home/username/tensorflow-master/models/research/object_detection/your any folder name/detect.tflite \ --input_shapes=1,300,300,3 \ --input_arrays=normalized_input_image_tensor \ --output_arrays='TFLite_Detection_PostProcess','TFLite_Detection_PostProcess:1','TFLite_Detection_PostProcess:2','TFLite_Detection_PostProcess:3'  \ --inference_type=FLOAT \ --mean_values=128 \ --std_values=128 \ --change_concat_input_ranges=false \ --allow_custom_ops
After this detect.tflite file will be generated then you can use this to port on device.

Hello guys,
@alokranjan007 @MohammadMoradi @WenguoLi @zhyj3038
i found one solution ,
After creating .pb file ,
add
--default_ranges_min=0
--default_ranges_max=255
along with
--inference_type=QUANTIZED_UINT8
It will create .tflite successfully and will work on mobile without causing any bytes issue.
Eg:-
bazel run -c opt tensorflow/contrib/lite/toco:toco --
--input_file=$OUTPUT_DIR/tflite_graph.pb
--output_file=$OUTPUT_DIR/custom_mobilenetv3.tflite
--input_shapes=1,300,300,3
--input_arrays=normalized_input_image_tensor
--output_arrays='TFLite_Detection_PostProcess','TFLite_Detection_PostProcess:1','TFLite_Detection_PostProcess:2','TFLite_Detection_PostProcess:3'
--inference_type=QUANTIZED_UINT8
--default_ranges_min=0
--default_ranges_max=255
--mean_values=128
--std_values=128
--change_concat_input_ranges=false
--allow_custom_ops
Thanks,

@jass-singh That's great that it is working now. I have not tried the above mentioned step. I will check.
Do you have any details how this "default_range_min and max" is solving the problem? Is there any link for detailed insights?
Cheers,

@jass-singh  Have you add other options when you run bazel to convert .pb to .tflite?
Because I have  also retrained my graph from the same checkpoint ssd_mobilenet_v1_coco_2017_11_17 as yours.
So the model is supposed to be a float model.
If I convert to .pb to .tflite without create the QUANTIZED_MODEL, I can get my .tflite successfully , but then I'll have the issue for Android studio (even I set TF_OD_API_IS_QUANTIZED=false), the app is crashed each time..
But When I tried your method to convert , I had the following error:
2018-10-03 18:49:12.586196: F tensorflow/contrib/lite/toco/graph_transformations/quantize.cc:560] Check failed: is_rnn_state_array  [1]    28561 abort (core dumped)  bazel run -c opt //tensorflow/contrib/lite/toco:toco --
Also could you tell me which branch you used when you did the covertion? ( I tried master and r1.9, the master could not even convert .pb to .tflite without option QUANTIZED_MODEL..)

@WenguoLi I see you closed on the recommendation to try "try --inference_type=FLOAT".
I have the exact same issue: it works for a float model, but not for a quantized model (--inference_type=QUANTIZED_UINT8).
The float model is too slow for me, and adding --default_ranges_min=0 and --default_ranges_max=255 makes the model unusable because of the low accuracy.
I'm retraining a custom image set from a quantized model ssd_mobilenet_v1_quantized_coco from the model zoo.
@andrehentz any ideas how to go forward?

@switchedfabric  did you solve it? How convert pb to quant tflite?

Array MobilenetV1/MobilenetV1/Conv2d_0/Relu6, which is an input to the DepthwiseConv operator producing the output array MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6, is lacking min/max data, which is necessary for quantization. If accuracy matters, either target a non-quantized output format, or run quantized training with your model from a floating point checkpoint to change the input graph to contain min/max information. If you don't care about accuracy, you can pass --default_ranges_min= and --default_ranges_max= for easy experimentation.

It says that it is better to do "run quantized training with your model from a floating point checkpoint to change the input graph to contain min/max information"
But all I have is .pb file generated by retrain.py (for classification weights), there is no any checkpoints

Array MobilenetV1/MobilenetV1/Conv2d_0/Relu6, which is an input to the DepthwiseConv operator producing the output array MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6, is lacking min/max data, which is necessary for quantization. If accuracy matters, either target a non-quantized output format, or run quantized training with your model from a floating point checkpoint to change the input graph to contain min/max information. If you don't care about accuracy, you can pass --default_ranges_min= and --default_ranges_max= for easy experimentation.
I am also getting same problem.
When i run with default_ranges_min=0 and default_ranges_max=255, the results are way off.
Any idea how we can solve this ??

@ignvinay , from the here, it's recommended that the default_ranges_max=6 due to the Relu6 function.

Can you try --inference_type=FLOAT?

thank you so much! you saved me

ihave faced a lot problems to get my model working using tensorflow lite. My thanks to this perfect forum. After read some books and undestand the all the kind process with tensorflow, i finally get my model working in a android envoriment

@duvictor Hi there, am glad that you got your model working, do you mind sharing your process, and difficulties, what i can see now, we are all facing these issues right now. the issues of converting tf1 model to QUANTIZED_UINT8, and with inference_type=FLOAT it convert successfully, but when you run on the model, it's give error even though TF_OD_API_IS_QUANTIZED = false; Thanks.

@WenguoLi I see you closed on the recommendation to try "try --inference_type=FLOAT".
I have the exact same issue: it works for a float model, but not for a quantized model (--inference_type=QUANTIZED_UINT8).
The float model is too slow for me, and adding --default_ranges_min=0 and --default_ranges_max=255 makes the model unusable because of the low accuracy.
I'm retraining a custom image set from a quantized model ssd_mobilenet_v1_quantized_coco from the model zoo.
@andrehentz any ideas how to go forward?

Hi, how did it go after you retrained the custom quantized model [ssd_mobilenet_v1_quantized_coco]


Client ID supplied, but get error: The access_token provided is invalid

According to the documentation - as of version 1.4, an access token is no longer required to display a user's feed when supplying a client ID, but I still get this error.
initFeed = function () {
        var feed = new Instafeed({
            clientId: '###',
            get: 'user',
            userId: '###',
        });
        feed.run();
    }

I am in Sandbox mode, but cannot submit requests as Instagram says this is not needed for a third party app to display my posts.

Hey @heaversm! Shortly after 1.4 was released, Instagram changed their API terms and introduced the Sandbox mode you're referencing.
To work inside sandbox mode, you'll need to issue yourself an access token using the client ID Instagram gives you.
Sorry for the out-of-date docs!

To work inside sandbox mode, you'll need to issue yourself an access token using the client ID Instagram gives you.

How do we do that?


Fix @all spam warning when typing @all in backticks.

When user'd like to send a message with @all in backticks
they see spam warning in spite of the fact that nobody
would be alerted.
Fixes: #1505.

Automated message from Dropbox CLA bot
@TomaszKolek, it looks like you've already signed the Dropbox CLA. Thanks!

Cool, can you also add some node tests for this regular expression (may make sense to refactor into its own function for easier testing)?  I feel like this may be a regular expression we end up changing a few times to perfect it, and we've got some nice test cases, so it seems worth adding some quick tests.

@timabbott
Please take a look at implementation. Not sure if it's a good move. If yes I will improve commit message.

Code looks reasonable, but it should be two commits -- one moving it to be a function in utils.js (without any functional changes), another changing the behavior (and adding the tests can come with that). -- that would make it a lot easier to read the diffs.

(Also, you should fix the linter failures in the backend test suite)

@timabbott:
Ready

This looks great.  Merged, thanks @TomaszKolek!


Cocoon push-status-to-github is failing

/cc @tvolkert @Hixie @keyonghan @godofredoc @digiter
https://flutter-dashboard.appspot.com/api/push-build-status-to-github is failing on some type conversion. Because the tree is currently red, this means the statuses won't get updated to github.
This is particularly bad for autorollers right now...

Strangely, it seems to not fail right now, but was definitely failing earlier in the weekend/Friday.

It only works on a red tree

I didn't put TODAY because this isn't reallya  release blocker/bad build creator, but this should be considered a high priority infra issue for sure.

This was caused by an invalid data store entry. For now, the fix was to delete this  entity. Long-term, the  dart backend must be resilient to bad data.


Proxy not working

{
StatusCodeError: 400 ,"message":"checkpoint requred", "checkpoint_url":"/challenge/45531281226/50dDySAQxB/"
}

Hey, could you share your entire code and other information related please ?


awsbatch based GPU (CUDA) job failed because of missing GPU

Environment:

AWS ParallelCluster 2.7.0
OS: alinux2
Scheduler: awsbatch
Master instance type: m5.large
Compute instance type: p3.2xlarge

Bug description and how to reproduce:
after creating an awsbatch based GPU environment, the job cannot be done because a GPU cannot be found. AWS Batch creates an ECS Container with an gpu-based ami, but the Job searches for ja free GPU and does not found one.
here is the log of the job:
| 2020-07-03T17:45:35.949+02:00 | Job id: 334ea99b-755c-4660-9baa-2981aa1b56e4:0
-- | --
  | 2020-07-03T17:45:35.949+02:00 | Initializing the environment...
  | 2020-07-03T17:45:35.949+02:00 | Starting ssh agents...
  | 2020-07-03T17:45:35.956+02:00 | Agent pid 7
  | 2020-07-03T17:45:35.961+02:00 | Identity added: /root/.ssh/id_rsa (/root/.ssh/id_rsa)
  | 2020-07-03T17:45:36.452+02:00 | Mounting /home...
  | 2020-07-03T17:45:36.547+02:00 | Mounting shared file system...
  | 2020-07-03T17:45:36.631+02:00 | Starting the job...
  | 2020-07-03T17:45:36.633+02:00 | /root
  | 2020-07-03T17:45:36.634+02:00 | Fri Jul 3 15:45:36 UTC 2020
  | 2020-07-03T17:45:36.635+02:00 | ls: cannot access /usr/lib/libXt*: No such file or directory
  | 2020-07-03T17:45:36.637+02:00 | ls: cannot access /usr/lib64/libXt*: No such file or directory
  | 2020-07-03T17:45:36.759+02:00 | Loaded plugins: ovl, priorities
  | 2020-07-03T17:45:39.538+02:00 | Resolving Dependencies
  | 2020-07-03T17:45:39.539+02:00 | --> Running transaction check
  | 2020-07-03T17:45:39.539+02:00 | ---> Package libXt.x86_64 0:1.1.5-3.amzn2.0.2 will be installed
  | 2020-07-03T17:45:39.547+02:00 | --> Processing Dependency: libSM.so.6()(64bit) for package: libXt-1.1.5-3.amzn2.0.2.x86_64
  | 2020-07-03T17:45:39.691+02:00 | --> Processing Dependency: libICE.so.6()(64bit) for package: libXt-1.1.5-3.amzn2.0.2.x86_64
  | 2020-07-03T17:45:39.693+02:00 | --> Running transaction check
  | 2020-07-03T17:45:39.693+02:00 | ---> Package libICE.x86_64 0:1.0.9-9.amzn2.0.2 will be installed
  | 2020-07-03T17:45:39.695+02:00 | ---> Package libSM.x86_64 0:1.2.2-2.amzn2.0.2 will be installed
  | 2020-07-03T17:45:39.839+02:00 | --> Finished Dependency Resolution
  | 2020-07-03T17:45:39.850+02:00 | Dependencies Resolved
  | 2020-07-03T17:45:39.851+02:00 | ================================================================================
  | 2020-07-03T17:45:39.851+02:00 | Package Arch Version Repository Size
  | 2020-07-03T17:45:39.851+02:00 | ================================================================================
  | 2020-07-03T17:45:39.851+02:00 | Installing:
  | 2020-07-03T17:45:39.851+02:00 | libXt x86_64 1.1.5-3.amzn2.0.2 amzn2-core 177 k
  | 2020-07-03T17:45:39.851+02:00 | Installing for dependencies:
  | 2020-07-03T17:45:39.851+02:00 | libICE x86_64 1.0.9-9.amzn2.0.2 amzn2-core 67 k
  | 2020-07-03T17:45:39.851+02:00 | libSM x86_64 1.2.2-2.amzn2.0.2 amzn2-core 39 k
  | 2020-07-03T17:45:39.851+02:00 | Transaction Summary
  | 2020-07-03T17:45:39.851+02:00 | ================================================================================
  | 2020-07-03T17:45:39.851+02:00 | Install 1 Package (+2 Dependent packages)
  | 2020-07-03T17:45:39.851+02:00 | Total download size: 284 k
  | 2020-07-03T17:45:39.851+02:00 | Installed size: 656 k
  | 2020-07-03T17:45:39.852+02:00 | Downloading packages:
  | 2020-07-03T17:45:39.955+02:00 | --------------------------------------------------------------------------------
  | 2020-07-03T17:45:39.955+02:00 | Total 2.7 MB/s \| 284 kB 00:00
  | 2020-07-03T17:45:39.961+02:00 | Running transaction check
  | 2020-07-03T17:45:40.104+02:00 | Running transaction test
  | 2020-07-03T17:45:40.114+02:00 | Transaction test succeeded
  | 2020-07-03T17:45:40.115+02:00 | Running transaction
  | 2020-07-03T17:45:40.191+02:00 | Installing : libICE-1.0.9-9.amzn2.0.2.x86_64 1/3
  | 2020-07-03T17:45:40.235+02:00 | Installing : libSM-1.2.2-2.amzn2.0.2.x86_64 2/3
  | 2020-07-03T17:45:40.262+02:00 | Installing : libXt-1.1.5-3.amzn2.0.2.x86_64 3/3
  | 2020-07-03T17:45:40.275+02:00 | Verifying : libSM-1.2.2-2.amzn2.0.2.x86_64 1/3
  | 2020-07-03T17:45:40.283+02:00 | Verifying : libICE-1.0.9-9.amzn2.0.2.x86_64 2/3
  | 2020-07-03T17:45:40.322+02:00 | Verifying : libXt-1.1.5-3.amzn2.0.2.x86_64 3/3
  | 2020-07-03T17:45:40.322+02:00 | Installed:
  | 2020-07-03T17:45:40.322+02:00 | libXt.x86_64 0:1.1.5-3.amzn2.0.2
  | 2020-07-03T17:45:40.322+02:00 | Dependency Installed:
  | 2020-07-03T17:45:40.322+02:00 | libICE.x86_64 0:1.0.9-9.amzn2.0.2 libSM.x86_64 0:1.2.2-2.amzn2.0.2
  | 2020-07-03T17:45:40.322+02:00 | Complete!
  | 2020-07-03T17:45:40.343+02:00 | ls: cannot access /usr/lib/libXt*: No such file or directory
  | 2020-07-03T17:45:40.345+02:00 | /usr/lib64/libXt.so.6
  | 2020-07-03T17:45:40.345+02:00 | /usr/lib64/libXt.so.6.0.0
  | 2020-07-03T17:45:40.345+02:00 | /home/ec2-user/cluster/fq_arrycontrol_tp40460826_5111_4a74_9603_11d6566c7c28.mat
  | 2020-07-03T17:45:40.345+02:00 | 1
  | 2020-07-03T17:45:48.115+02:00 | HawkSpex(R)Flow - Analytics Workflow
  | 2020-07-03T17:45:48.115+02:00 | Version 1.5-cecdccf4bf72cc35356263026a63aceb6d862540
  | 2020-07-03T17:45:48.115+02:00 | \n
  | 2020-07-03T17:45:48.213+02:00 | remoteArrayJob fargFile /home/ec2-user/cluster/fq_arrycontrol_tp40460826_5111_4a74_9603_11d6566c7c28.mat jobCounter 1
  | 2020-07-03T17:45:48.220+02:00 | Load Data from /home/ec2-user/cluster/fq_arrycontrol_tp40460826_5111_4a74_9603_11d6566c7c28.mat
  | 2020-07-03T17:45:48.244+02:00 | Starting Job with Number: 1
  | 2020-07-03T17:45:48.246+02:00 | /home/ec2-user/cluster/fq_train_model_00001_tpd815fbed_6466_4b49_8f97_6296dea89e3a.mat
  | 2020-07-03T17:45:48.883+02:00 | Test if one GPU is free of 0
  | 2020-07-03T17:45:48.883+02:00 | INFO Param wait4GPU: 5 min
  | 2020-07-03T17:45:48.883+02:00 | INFO Param maxGPUload: 35 %
  | 2020-07-03T17:45:48.886+02:00 | INFO Param maxGPURAMload: 50 %
  | 2020-07-03T17:45:48.887+02:00 | Using CPU!
  | 2020-07-03T17:45:49.905+02:00 |
  | 2020-07-03T17:45:49.905+02:00 | Computing Resources:
  | 2020-07-03T17:45:49.909+02:00 | MEX on GLNXA64
  | 2020-07-03T17:45:49.909+02:00 |
  | 2020-07-03T17:45:50.204+02:00 | Finish MLP training
  | 2020-07-03T17:45:50.205+02:00 | Model NNET:MLP learnt with average 0.022353 sec per iteration
  | 2020-07-03T17:45:52.911+02:00 | Fri Jul 3 15:45:52 UTC 2020

as you can see in the last part our script tries to find a free GPU and cannot find one. As a result of this error the script echos that it is using a CPU instead.
Does i have to set a special parameter to use aws-parallelcluster for an awsbatch CUDA based GPU Environment?
I can't find any documentation or manuals on how to create a gpu-based cluster via aws-parallelcluster using awsbatch as scheduler and what is the best configuration for it.
the pcluster-config is the following:
[aws]
aws_region_name = eu-central-1

[global]
cluster_template = default
sanity_check = true
update_check = true

[aliases]
ssh = ssh {CFN_USER}@{MASTER_IP} {ARGS}

[cluster default]
key_name = XXXXXXXXXXXXXXXXXXXXX
base_os = alinux2
scheduler = awsbatch
master_instance_type = m5.large
desired_vcpus = 4
post_install = https://XXXXXXXXXXXXXXXXX.s3.amazonaws.com/post_install.sh
master_root_volume_size = 200
extra_json = { "cluster" : { "ganglia_enabled" : "yes" } }
vpc_settings = default
s3_read_resource = *

[cluster GPU]
key_name = XXXXXXXXXXXXXXXXXXXXXX
base_os = alinux2
scheduler = awsbatch
compute_instance_type = p3.2xlarge
master_instance_type = m5.large
desired_vcpus = 4
post_install = https://XXXXXXXXXXXXXXXXXXXXXXX.s3.amazonaws.com/post_install-gpu.sh
master_root_volume_size = 200
extra_json = { "cluster" : { "ganglia_enabled" : "yes" } }
vpc_settings = default
s3_read_resource = *

[vpc default]
vpc_id = vpc-XXXXXXXXXXXX
master_subnet_id = subnet-XXXXXXXXX
compute_subnet_id = subnet-XXXXXXXX
additional_sg = sg-XXXXXXXXX

Hi @trsludwig,
Unfortunately GPU options is not currently supported for ParallelCluster-AWSBatch integration. I will mark this issue as a feature request.
To run GPU jobs using AWSBatch console or CLI directly, please see the official documentation here
If you are still interested in using ParallelCluster for GPU workflow, please check out ParallelCluster's integration with Slurm, of which we do support specifying GPU option in job submission commands.
Hope that helps!

Hi @rexcsn,
thank you for your quick response.
Could you please include it in the official documentation that the awsbatch scheduler cannot process jobs with GPU support. Then please include a reference to the Slurm Scheduler.
I hope that you will implement this enhancement very soon, since AWS Batch itself has the ability to run GPU-based jobs.
many thanks in advance and stay healthy!
best regards
Sebastian


Result page

Bro I need you to write a result page when the game ends.
Currently, the game will show a toast if it ran out of words. This ain't good enough man.
Do it or you'll get no weekend rest.

Implemented in this MR


Add check for root/ephemeral disk size when creating virtual guest

Add a check for root disk/ephemeral disk size when creating virtual guest
Signed-off-by: Edward Zhang<EMAIL_ADDRESS>

Cool. Cheers :beers:


./setup.sh: line 13: ./c/build_all/linux/setup.sh: No such file or directory

OS and version used: Linux 6d8edc4b4e3f 4.9.13-moby #1 SMP Sat Mar 25 02:48:44 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux (Docker ubuntu image)

Python runtime used: python2.7.2

SDK version used: latest download

Description of the issue:
Im trying to setup the env and inside the folder build_all/linux i tried to run the command ./setup.sh but get the following error.
python: can't open file 'version': [Errno 2] No such file or directory
Code sample exhibiting the issue:
Console log of the issue:
(bossa) docker@6d8edc4b4e3f:~/bossa/azure-iot-sdk-python/build_all/linux$ python version
python: can't open file 'version': [Errno 2] No such file or directory

When cloning the repository, be sure to use --recursive like this:
git clone https://github.com/Azure/azure-iot-sdk-python --recursive

setup.sh: line 13:
13c13
< ./c/build_all/linux/setup.sh

./build_all/linux/setup.sh

The problem is that when we clone the repo, the c directory is empty.

When you are cloning the repo use the "submodule update --init --recursive" options.
With that, all the submodules will be cloned and updated.
Best Regards,
Zoltan

@zolvarga I think this should be mentioned in the docs.

@bsafwen - It is mentioned in the readme section below:
https://github.com/Azure/azure-iot-sdk-python#how-to-clone-the-repository


Fix the issue that storm could be executed thousands of times if some HTTP requests take long time to return or error out

Current way of checking timeout may be blocked by one task not coming back for a long time. It gets worse when there are many storms in a short period, as previous unfinished requests are still executing, causing slower server response, and some of the storms could be executed thousands of times, making the situation even worse. In extreme cases, the app runs out of old space heap and crashes.

Storm task dispatches at 60ms or at the completion of task t, whichever comes first.
The case that would cause millions of requests to queue up is the request fails or completes immediately, causing it to spin up even more of those instant completes/failure.
Worst of all, my RateLimiter will process at most 50 requests per second (threshold for 412) no matter what, eventually leads to an overflow of tasks in the Circular Linked List.
So network is a pain 233

Right, it certainly could cause tons of requests. Though, in my case, the issues was caused by some requests taking too long to return. I didn't check node.js document to find out the default timeout in HTTP request, but I suspect what happened was:

likely one request timed out, which caused Xhr to abort the connection, which in turn caused an HttpError
BilibiliRest would retry on HttpError.
Meanwhile, since Promise.all() is blocked, quit flag is not set, and maybe around 2 thousands requests have been sent (assuming HTTP timeout is 2 minutes), all these requests caused most of them to timeout again, including the original one, which would cause another abortion and HttpError, which would be retired for the last time, and only after that Promise.all() would be solved and quit flag set.

So assuming HTTP timeout is 2 minutes, this could easily be more than 6 minutes in execution. In the log I saw that before it crashed (running out of 2G heap space 😮) the last storm had more than 18000 executions. It was a miracle that they didn't ban my account outright. 🤣

Actually one thing I would suggest is to allow client to specify # of tries in request. For most requests like guard, gift, we certainly want to retry couple of times. However, for failed storm request there is no need to retry.

Huge mistake, I implemented a default 4s timeout for the monitor but did not do the same for the client here.

With storms, my observations were—requests need to come in short intervals, need to continue for a period of time, hence the 60ms per requests and 25s deadline...
For other gifts I haven't encountered signs of failure, though. Any clue what went wrong?

I haven't analyzed responses from those storm requests so I don't have a clue. I was a bit surprised when I saw the implementation since when I manual tried to claim storm from app it didn't seem to require more than one click. I will try to debug a bit but I kind of doubt if I can find anything...


Allow manifest, file list via CLI

Currently the file set to upload in the push command is automatically determined. It would be helpful to be able to specify files (both manifest and js) via the command line as well.
The particular use case is to be able to deploy different configurations -- e.g. in test mode I want to use an alternate manifest with execution API enabled, tests bundled, etc. while in prod mode I want to skip all that.

Do you mean test/prod options like #12?

Sort of, but not just the project ID. Suppose the same technique could be used with renaming .claspignore and manifest files, but it's clunky. Better would be to just take the file patterns as optional arguments. If they're present, push those files. If not, fall back on the current algorithm.
Ideally we'd have both an environment option for auth/project ID and a way to easily change file sets. I'd like my package.json to look something like:
"scripts": {
"push-test": "clasp push --env=test appsscript.test.json test/.js src/.js"
"push-prod": "clasp push --env=prod appscript.prod.json src/**.js",
...
}

I don't see a use-case where a 1-line bash script can't solve. I'd rather have the CLI be minimal and use git's features or a bash file instead.

A few reasons:

It's not a 1 line script. Also need to make sure the ephemeral files are ignored by git or whatever source control system is being used.
Sometimes expressing things in the affirmative is easier than expressing them in the negative. Right now clasp only allows expressing things negatively -- tell me the files you don't want to push. In more complex projects, the affirmative expression can end up being more concise.
Taking args via CLI accommodates different build systems. Some build systems (e.g. bazel) don't put generated/intermediate files under the project directory, but rather in a separate parallel tree to avoid polluting the source dir. Clasp should be accommodating here.

I'm certainly open to other ways of solving the problem. But in general, it's pretty common that any CLI tools that operate on files allow passing the paths via arguments. That part shouldn't be controversial.

Questions (Can you modify the first comment with the details about this FR to reduce discussion?):

Can you point to some similar flags/samples in other CLIs?
Can you have a more concrete example? I don't really understand the use-case and why you need this feature.
Can we modify how .claspignore works to accommodate explicitly kept files?
Why can't you just do this:

mv .claspignore-prod .claspignore && mv .appsscript-prod.json .appsscript.json
mv .claspignore-test .claspignore && mv .appsscript-test.json .appsscript.json

Updated the original comment w/examples of other CLIs that behave this way as well as the use case later mentioned in the discussion.

There is similar CLI as clasp. it is gas-manager.
gas-manager has options to specify environment(project ID), credential, etc...
Please see https://github.com/soundTricker/gas-manager#cli

I'll look at PR proposals that use npm's config for environments in package.json.
{
  "config": {
    "env":  {
      "prod": ...
      "test": ...
    }
  }
}

I don't see a future where I can support this feature.
Hopefully a wrapper bash script can solve the issue at hand.
Closing this issue, but feel free to comment here as it can be re-opened at a later date.


feat(client): add server_port && client port handling

🦙 MegaLinter status: ❌ ERROR

Descriptor
Linter
Files
Fixed
Errors
Elapsed time

✅ CPP
clang-format
24
5
0
0.1s

❌ CPP
cpplint
24

2
0.46s

See detailed report in MegaLinter reports
MegaLinter is graciously provided by


auth-helpers-nextjs@next sign out sync

Bug report
Describe the bug
Am experimenting with @next of auth-helpers due to #171 and announcement of https://supabase.com/blog/supabase-js-v2 which  appears to address the signed out issue as @latest doesn't use @supabase/supabase-js@rc.
"@supabase/auth-helpers-nextjs": "^0.4.0-next.0",
"@supabase/auth-helpers-react": "^0.3.0-next.0",
"@supabase/auth-helpers-shared": "^0.2.0-next.0",
"@supabase/supabase-js": "2.0.0-rc.7",

As the /api/auth helpers are no longer in this package, I created a new API logout endpoint that calls supabaseClient.auth.signOut(). However, the signed out state does not appear to reflect client-side. It retains the current session and onAuthStateChange does not fire with the SIGNED_OUT event. Signing out on the client works fine.
If we wanted to keep supabase calls in the API like the latest helper, how would we trigger an update in the client to fetch the current session state?
I understand that @next is in progress and that this issue may be moot once it is released, but I want to raise this just in case.
To Reproduce
With @next versions of helpers and @rc of supabase-js in nextjs:
While authenticated in the client (and using the new SessionContextProvider), call await supabaseClient.auth.signOut(); from an /api endpoint.
onAuthStateChange will not fire SIGNED_OUT event, client will show past session, while subsequent /api calls will have no active session.
Expected behavior
For signed out session state initiated in next.js API to reflect in the client.
System information

OS: macOS
Browser (if applies) Chrome
Version of supabase-js: see above
Version of Node.js: 16.14.2

Having the same problem

Sorry about this, see the newly created migration guide: https://github.com/supabase/auth-helpers/blob/next/packages/nextjs/MIGRATION_GUIDE.md#migrating-to-03x


Before executing uv python uninstall, check if it is currently in use.

uv version: uv 0.2.35 (e097f948c 2024-08-09)
OS: Windows 11 x86-64
Because the tools installed by the uv tool may rely on a managed Python environment, deleting the Python used could potentially damage the tools.
e.g.

Thanks. I believe this is a duplicate of #4718.


Added ability to install package dependencies before generating Docker Image

Resolves
Fixes #372
Description
This PR adds the ability to install package dependencies in the generated ASP.NET Core project prior to running Docker Build so that all dependencies are accounted for.

@AnoojNair  / @Brett-Parker  / @willvelida this is also ready for a review. This PR ensures that we have the correct dependencies installed in the Docker image

Thank you for the review @Brett-Parker! Let me have a look at the failing tests


ROX-0: Check PR title

Description
Check if PR title matches a "good PR title" regex, and if it fits 100 characters.
Testing Performed
See the check runs of this PR.

We need to change dependabot PRs first

See #6216.

https://regex101.com/r/QQVZi4/1

input
pass

ROX-123,ROX-123: ok fasdfa adfa sdfas asdf sdaffas 123123 423
✔

ROX-123: dfased
✔

ok:sdfqase
:x:

ROX-: fasf
:x:

ROX-1: dfasd
✔

feat: allow provided config object to extend other configs
✔

feat(api)!: send an email to the customer when a product is shipped
✔

feat: code
✔

chore(deps): bump github.com/stretchr/testify from 1.8.2 to 1.8.3
✔

One thing I realized after looking at https://github.com/stackrox/stackrox/pull/6318 title is that we may have a bunch of automation scripts that occasionally open PRs.
Failing their CI, especially in the blocking way may create problems during the release or other maintenance.
Can PRs by bots be excluded from this rule checking?

Sorry, I'll block the PR due to #6107 (comment) so that we can be sure we're safe to not break something automated.

The check is not required to pass, so I think it shouldn't break automation.
For dependabot PRs I disabled the length check.

/retest

Guys, my title is actually 62 long: https://github.com/stackrox/stackrox/pull/6218
PRs dealing with more than one JIRA are being punished by this.

I think that's exactly the point - to be thoughtful of the length. There's a number of ways to shorten the title. E.g.
$ python -c 'print(len("ROX-15458, ROX-16687: Add resending NodeInventory when no ACK comes"))'
67

I think that's exactly the point - to be thoughtful of the length. There's a number of ways to shorten the title. E.g.
$ python -c 'print(len("ROX-15458, ROX-16687: Add resending NodeInventory when no ACK comes"))'
67

I wanted to say, that the JIRAs should not be counted as title. The more of them the less text you have.

I'm afraid one just can't convince GitHub to exclude jira numbers when truncating commit messages at 70 chars.


on_attach is being called twice when separate_diagnostic_server is true

Is this intentional? This is causing issues with twoslash-queries, causing duplicate virtual text. Here is my full config:
require('typescript-tools').setup {
  on_attach = function(client, bufnr)
    require('twoslash-queries').attach(client, bufnr)
    require('user.lsp').on_attach(client, bufnr)
  end,
  settings = {
    separate_diagnostic_server = true,
    publish_diagnostic_on = 'insert_leave',
    tsserver_file_preferences = {
      includeCompletionsForModuleExports = true,

      -- inlay hints
      includeInlayParameterNameHints = 'literals',
      includeInlayParameterNameHintsWhenArgumentMatchesName = false,
      includeInlayFunctionParameterTypeHints = true,
      includeInlayVariableTypeHints = true,
      includeInlayVariableTypeHintsWhenTypeMatchesName = false,
      includeInlayPropertyDeclarationTypeHints = true,
      includeInlayFunctionLikeReturnTypeHints = true,
      includeInlayEnumMemberValueHints = true,
    },
    tsserver_format_options = {
      allowIncompleteCompletions = false,
      allowRenameOfImportPath = false,
    },
  },
}

Probably it isn't. We spawn 2 tsservers in this mode indeed, but still one lsp should be attached. I need to check this.

@b0o it should be fixed in connected pr, can you check it?

@b0o it should be fixed in connected pr, can you check it?

Yes, that fixed it. Thank you!

@b0o merged into master! Thanks for checking it up.

Probably it isn't. We spawn 2 tsservers in this mode indeed, but still one lsp should be attached. I need to check this.

I think it might be because they didn't disable the tsserver.

I think it might be because they didn't disable the tsserver

Nope, I only had typescript-tools enabled.

I think it might be because they didn't disable the tsserver

Nope, I only had typescript-tools enabled.

The latest fix PR is problematic; you can try using it to open a React project. Then attempt to rename a variable, and open two files consecutively. You will notice that only the first file is affected.

Hmm, I don't have the same issue here. Opening two files and renaming a variable shared between them works as expected.

@chaozwn does #218 fix this for you?

@chaozwn does #218 fix this for you?

In fact, it hasn't, and it has introduced additional issues. I saw someone under that PR with the same error as me. The LSP only affects the first buffer.

@chaozwn does #218 fix this for you?

I'll test it out.

@chaozwn does #218 fix this for you?

works well. wait merge.


Spec11 reporting to be enchanced

All discovered domains to be stored in database table.
To be generated better daily and monthly report - both total and per registrar.

This is there. Report will be improved for v1.1


SetAsync() method was never called in this tutorial?

Hi, could you please explain how the user profile data still gets saved by the state, despite never calling the SetAsync method? In all previous tutorials we called SetAsync() followed by SaveChanges(). But this tutorial only calls SaveChanges(). I tried reproducing this behavior in another tutorial by commenting out the SetAsync() call and leaving only the SaveChanges() call, but it didn't save the data... I'm puzzled, why does this tutorial not need SetAsync() while the other does? The other tutorial I'm talking about is this one: https://docs.microsoft.com/en-us/azure/bot-service/bot-builder-prompts?view=azure-bot-service-4.0&tabs=csharp

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 04c5adf9-272a-e0f1-10f1-c8365e76035b
Version Independent ID: 1982af41-5a06-4398-0e95-abcc50864e0d
Content: Implement sequential conversation flow - Bot Service
Content Source: articles/v4sdk/bot-builder-dialog-manage-conversation-flow.md
Service: bot-service
GitHub Login: @JonathanFingold
Microsoft Alias: v-jofing

In this sample, the user profiles' get and set async methods are being called from within the dialog steps, but the user state's save changes async method is called in the turn handler, after the dialog is continued.

I am sorry but the dialog steps do not call the SetAsync() method. They only call the GetAsync() method. Maybe the source code is out of date? But this still doesn't give an answer. The project runs fine and saves the data even though it nevers calls SetAsync()...

No worries, I read through this too quickly. Here's why this works without calling SetAsync. (I'll refer to some information that's in the state property accessor methods section of the Managing state topic.)

The first GetAsync call in a turn creates and populates an entry in the state cache. It then returns a reference to that "cached object".

As long as the dialog code keeps this reference intact, any changes to that reference are being made to the cache. (This isn't considered "best practice", but that's what's in this sample at the moment.)
If you had a state property accessor for a C# value type, the reference would immediately be lost, due to the way C# handles value types. The user profile property is a reference type, so we're okay.
If the dialog had created a new object, and wanted to assign that as the value of the property, then the dialog would need to call SetAsync to update the cache.

When the turn handler calls SaveChangesAsync, the cache is written back out to storage.

The samples in the repo are scheduled to be updated in a couple weeks, and we're working on updated how-to topics to go with them. Until then, I hope this explanation helps.

@benamarm Closing. Please reopen if you are still blocked.


Upsert into vec0 tables?

I tried the following query:
INSERT INTO vec_items(rowid, embedding) VALUES (?, ?) ON CONFLICT(rowid) DO UPDATE SET embedding = excluded.embedding;
and got:
UPSERT not implemented for virtual table "vec_items"
Is upsert supported in some form?

@gospodinbodurov thanks for the report! Initially I though UPSERT wasn't support for virtual tables, as mentioned in the SQLite docs:

UPSERT does not currently work for virtual tables.

But now I think that's outdated. Other docs mention a few other APIs that may help:

SQLITE_VTAB_CONSTRAINT_SUPPORT in sqlite3_vtab_config()
sqlite3_vtab_on_conflict()

So I'll try to include proper UPSERT support in an upcoming release!

You are welcome.
P.S. Not sure whether this is the right place for asking, but where I can find the different supported distance metrics? I guess at the moment cosine and l2 are the only ones?

cosine, l1, and l2. is there any other you'd be interested in?

At the moment I thinks the existing ones are good enough, but I am wondering how to use them - could not find their usage in the documentation.
P.S. I plan integrating this project in our platform and that's the reason I am asking about the upsert functionality and what distance functions are supported. If upsert will not be supported I will rebuild the whole database from scratch during updates.

docs are lacking but for vec0 tables you can specify a 'distance_metric=cosine' option after the vector column declaration, hoping to update the docs early next week with samples
i'll also try to get upsert support soon! dont think it'll take too long but i won't be at a computer for a few more days

@asg017 I'd also like to do query / searches based on Hamming distance of a binary quantized vector. Something like distance metric = hamming

@z3ugma if you use bit[N] for your vector column type, then the MATCH operator will  automatically use hamming distance for you:
CREATE VIRTUAL TABLE vec_sample using vec0(
  bit_embedding bit[8]
);

insert into vec_sample(rowid, bit_embedding) values
  (1, vec_bit(X'FF')),
  (2, vec_bit(X'00')),
  (3, vec_bit(X'0F'));

select
  rowid,
  vec_to_json(bit_embedding),
  distance
from vec_sample
where bit_embedding match vec_bit(X'FF') and k = 3;

/*
┌───────┬────────────────────────────┬──────────┐
│ rowid │ vec_to_json(bit_embedding) │ distance │
├───────┼────────────────────────────┼──────────┤
│ 1     │ '[1,1,1,1,1,1,1,1]'        │ 0.0      │
│ 3     │ '[1,1,1,1,0,0,0,0]'        │ 4.0      │
│ 2     │ '[0,0,0,0,0,0,0,0]'        │ 8.0      │
└───────┴────────────────────────────┴──────────┘
*/

This was done because cosine/l2/l1 distance didn't make sense for binary vectors, and hamming distance was the only distance metric that makes sense for binary vectors.
Happy to support a distance_metric= option for binary vectors if there are use-cases for other bit vector distance metrics!

This is great! Will it return simultaneous responses for an array of input query vectors?
Or does the query need to go one input embedding at a time


Repo maintenance

Overhaul of the repository aspect
The main aspects of this PR are:

[x] Adding ucompiler configuration
[x] Add eslint config.
[x] Move the specs to ES6
[ ] Fix the specs on Windows
[ ] Update CI config

ucompiler configuration
Although babel transpilation support was in there already, this adds the
ability to do npm run watch to have constant rebuilds of the code while
working on it. It also seems the babel version had two blank lines at the
end, which this fixes.
eslint config
How this didn't exist until now is beyond me, but here is where it starts
apparently :stuck_out_tongue:. Fixing the linting issues exposed by this
involves refactoring a few of the functions, and in general should result in
cleaner code.
Move the specs to ES6
Let's get rid of the last vestiges of CoffeeScript :stuck_out_tongue:.
Fix the specs on Windows
Currently running npm test on Windows results in a lot of errors, we should
have passing specs regardless of the OS!
Update CI config
Currently we are only building on the OS X containers on Travis-CI, and not in
an optimal manner even on there. The CI builds will look like this when
finished:

Travis-CI: Atom Stable + Beta, on both Linux and OS X
AppVeyor: Atom Stable on Windows
CircleCI: If we want an alternative Linux image to test as well.

NOT READY - DO NOT MERGE!

This is what I get on ubuntu

Fixed rangeFromLinNumber, looking into findAsync.

The cat.exe comes from here: http://unxutils.sourceforge.net/

I've reviewed the code and it Looks Good to Me and should work

I've reviewed the code about and it Looks Good To Me and should work

CI is apparently ignoring some uncaught errors on *NIX, investigating.

Huh, can't reproduce this locally. As everything seems to be working properly I'm merging this :grinning:.


svelte-kit is unable to pickup nested dependency from a locally linked component library module

Describe the bug
I have a locally installed svelte-kit component library project that I have linked it to my main svelte-kit app project.
I have used "my-lib": "link:../my-lib/package" to link this project to my svelte-kit app package.json.
When I build my main project using svelte-kit build, its unable to pickup the transient dependencies used by my component library.
A simple workaround is to install the dependency to my main project. Is this how it is expected to work. zI have raised this as
a bug because it feels like it is leaking the self-containment of my component library.
Reason I have raised this issue under this repo is because, I thought it might be related to #263
Reproduction
https://github.com/bhvngt/svelte-dependency-issue/
Logs
Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'dayjs' imported from svelte-dependency-issue/my-app/.svelte-kit/output/server/entries/pages/__layout.svelte.js
 at new NodeError (node:internal/errors:371:5)
    at packageResolve (node:internal/modules/esm/resolve:930:9)
    at moduleResolve (node:internal/modules/esm/resolve:976:18)
    at defaultResolve (node:internal/modules/esm/resolve:1078:11)
    at ESMLoader.resolve (node:internal/modules/esm/loader:530:30)
    at ESMLoader.getModuleJob (node:internal/modules/esm/loader:251:18)
    at ModuleWrap.<anonymous> (node:internal/modules/esm/module_job:79:40)
    at link (node:internal/modules/esm/module_job:78:36)

System Info
System:
    OS: macOS 12.3
    CPU: (10) arm64 Apple M1 Pro
    Memory: 773.31 MB / 32.00 GB
    Shell: 3.4.0 - /opt/homebrew/bin/fish
  Binaries:
    Node: 16.14.0 - ~/Library/Caches/fnm_multishells/74691_1648750303350/bin/node
    npm: 8.3.1 - ~/Library/Caches/fnm_multishells/74691_1648750303350/bin/npm
  Browsers:
    Chrome: 100.0.4896.60
    Chrome Canary: 102.0.4977.0
    Firefox: 97.0.1
    Firefox Developer Edition: 99.0
    Safari: 15.4

Severity
annoyance

Perhaps this is related to https://github.com/sveltejs/kit/issues/4261. Does it happen only when the linked library is a Svelte library?

I tried importing a sample lodash module - chunk in a separate node esm module based local project. I am getting a similar error when I try to do svelte-kit build with that project.
sveltejs/kit#4261 seems to be highlighting the same issue. As I too faced this issue in my rushjs + pnpm project.
I guess I will close this issue here as it seems to be an issue with the svelte-kit project.


Batch size option for bulk inserts

Is this being worked upon? And is there anyway to increase the bulk insert limit from 30K to maybe 1M?


chore(tiflash): update CI/CD pipelines

update the build script path.
Ref https://github.com/PingCAP-QE/ci/pull/3216
Signed-off-by: wuhuizuo<EMAIL_ADDRESS>

The CD pipeline is for old devbuild, it will not be deprecated in recently future weeks.


#6875 deliver: also use --force as a way to overwrite metadata

This is related to #6875
Deliver requires a specific environment variable to overwrite metadata
Users expect --force to work. We add support for it, while keeping backward compatibility.
Documentation isn't updated as the env. variable wasn't made public.

@lacostej :)

This PR is related to https://github.com/fastlane/fastlane/issues/9306 right?

@ohayon #9306 is another issue that I intend to look at at some point.

@KrauseFx I had managed to have a bug in it... I now fixed it and tested it on a live project. Also added more tests.

@ohayon finally revised the patch with the proper boolean logic (and fixed the tests)

@ohayon ping! :)


Migrate to Exonum 0.9.2 [ECR-1896]

Overview
Added support for Exonum 0.9.2
Big thanks to @aleksuss
Runs without issues locally.
Rust has been updated to version 1.27.2, which breaks EJB App building in master.

See: https://jira.bf.local/browse/ECR-1896
Definition of Done

[ ] There are no TODOs left in the code
[ ] Change is covered by automated tests
[ ] The coding guidelines are followed
[ ] Public API has Javadoc
[ ] Method preconditions are checked and documented in the Javadoc of the method
[ ] Changelog is updated if needed (in case of notable or breaking changes)
[ ] The continuous integration build passes

Travis is failed because of cargo audit:

is it transitive?

@ivan-ochc , would you test this please through our QA service? @vitvakatu , do you know if it is already supported by our harness?

is it transitive? Why can't we update?

We already have a task for smallvec (ECR-1902)

@ivan-ochc , would you test this please through our QA service? @vitvakatu , do you know if it is already supported by our harness?

Yeah, should be supported.

@vitvakatu Why smallvec is broken here but not in the 0.8? If it's a new transitive, let's disable audit in this branch.

Decided to disable cargo audit in the branch because of broken transitive dependencies.


Prepare "getAccounts" for pagination

https://github.com/coinbase/coinbase-node/blob/master/lib/Client.js#L106
https://github.com/coinbase/coinbase-node/blob/master/lib/model/Account.js#L165
Compare these two guys. Account.getAddresses is prepared for pagination. To get pagination working for Client.getAccounts one has to rewrite the whole function. Not really following a pattern here. I would also pass the same parameters to the Client.getAccounts function.

Closing as this issue is affecting older version of the library


[Finish #120646643] Move location of edit profile

What this PR does
Moves the edit functionality of the sidebar into a menu on the card.
Relevant Pivotal Tracker stories
Moves the edit functionality of the sidebar into a menu on the card.

Coverage remained the same at 82.38% when pulling a104e1e5c3471433bd7a232e88eba3298764d379 on chore/sidebar-update into d9fcafde10de7e749d5044d6f6acfe6a90c9c94a on feature/documents.

Coverage remained the same at 82.38% when pulling f4b2090cfdafd298a0dba4b757da364b90cb09b2 on chore/sidebar-update into d9fcafde10de7e749d5044d6f6acfe6a90c9c94a on feature/documents.


Add methods parsing query parameters and storing tokens to a localsto…

Add following methods to CognitoUtil
1. storeTokenFromQueryString
This method parses a query string of given callback URI and retrieves access_token, id_token and expires_in. Then it stores these values to a localstorage through storeToken method.
2. storeToken
This method stores access_token, id_token and expires_in in localstorage.

Thank you for your comments.

Copyright のあとは著作権者書かないといけないと思います。

Oh, I forgot it. I'll do so!

const な変数には方宣言入れないって感じですよね？

I think it is better to omit a type annotation when it can be inferred.