Palette updates 🎨

Summary
New colors

Example application

Proposal
We'll need to expose the colors so that client of the library can use them outside of components as needed:
Here's a draft of how the API cool look like?
I believe we'll have two taxonomy levels:

the colour itself ( primary , secondary , etc... )
the variations of the colour ( lighter , darket , etc... )

import { colors } from '@zopauk/react-components'

colors.primary.basic // → '#00B9A7'
colors.primary.lighter // → '#G0E9A7'
colors.primary.darker //  → '#00G9A7'

colors.secondary.basic // → '#01B9A7'
colors.secondary.lighter // → '#40B9A7'
colors.secondary.darker // → '#90B9A7'

// or can be expressed with arrays too:

colors.primary.basic = '#00B9A7'
colors.primary.shades = [ '#50B9A7' , '#G0E9A7' ,  '#00G9A7' ] // the lower the index the lighter the shade

I prefer to make it explicit. Like colors.secondary.darker rather than array that it can be confusing and bad for readability.

Addressed on 2.0 ☝

I was looking into this and was thinking about a helper function to access colours similar to:
color('type', 'shade');

My reasoning behind this is the colour api would be more adaptable behind a functional abstraction.
Meaning we could remove colours and add colours without breaking the implementations in any components.
It also it eliminates the need to add basic as a property which is a nice shorthand.
This way could also have fallback colours in the event the colour api was changed for example:
color('opps', 'fail') || 'red'; // red
// ---
colors.opps.fail || 'red' // TYPE ERROR

I made a code pen so you could see what I mean: https://codepen.io/moshie/pen/KKPmJzr?editors=0012

Hi @moshie, thanks for your suggestion 💯
I think is something we could consider on a future release 🤔
This is our new colour spec.
By reading the object directly:

TS warns at compilet time if you're reading something that doesn't exist.
Get auto-complete for free in your editor
You don't need to type it as TS can infer it easily

I think getters are useful when the object structure behind changes a lot or you don't have control over it. They do introduce challenges around typing and make the API less obvious 🧐
We hope though our colours won't change in the near future and stay pretty stable, hence I think we should be fine for now.
You could open a separate issue though if you think is something we can discuss more 👍🏻

Hi @lluia, No problem 👍
The more I think about this the more I am coming around to the object approach, I think I just needed to hear it from someone else.
As you say if the colours aren't going to change too much 🤞 the object approach is way more TS & IDE friendly.
Thanks for the explanation! 👌

:tada: This issue has been resolved in version 2.0.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Add the Configure a Custom Domain for APIs guide

Resolves https://github.com/wso2-enterprise/choreo/issues/15701

@RukshiW Let's encrypt certificates can be use in the production use cases as well and not only for the testing purposes. Shall we remove For testing purposes, you can also use the 'Let's encrypt' option. statement

@RukshiW Let's encrypt certificates can be use in the production use cases as well and not only for the testing purposes. Shall we remove For testing purposes, you can also use the 'Let's encrypt' option. statement

Removed this note.


Issue with extending annotations of entity over defined ones via aspect

Hi,
I have the following issue related to extending already existing annotations on top of the entity.
Follow the example: https://github.tools.sap/I540823/tutorial-be/blob/aspect-issue/db/schema.cds#L53
It shows the following error

However, once the annotation over Gender entity is removed, in that case only aspect annotation is applied, it shows  populated line items from aspect in metadata.

Hi @thecoldstone ,
Please ask this question in the community as we don't do development support in here. If you find the documentation is wrong or unclear please let me know and we'll fix it.
Thanks,
René


go drive inner db version is not same as installed db

I install SQLite with version 3.28.0, however when I use this driver to run SELECT sqlite_version();, a different version 3.36.0 returned.

By default this package compiles and embeds its own sqlite. If you want to link externally against your locally installed library you need to build with the libsqlite3 tag.

I got it, thanks for your reply.


Better conan integration

Codecov Report

Merging #16 (3009161) into main (1cd2256) will decrease coverage by 25.17%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##             main      #16       +/-   ##
===========================================
- Coverage   79.96%   54.78%   -25.18%
===========================================
  Files          31       28        -3
  Lines        1522     1349      -173
  Branches      380      270      -110
===========================================
- Hits         1217      739      -478
- Misses        233      441      +208
- Partials       72      169       +97

Flag
Coverage Δ

Linux
?

Windows
?

macOS
54.78% <ø> (-9.07%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

include/cppsas7bdat/datasink_null.hpp
15.00% <ø> (+3.46%)
:arrow_up:

src/types.hpp
0.00% <0.00%> (-100.00%)
:arrow_down:

src/formatters.hpp
2.46% <0.00%> (-95.36%)
:arrow_down:

src/decompressors.hpp
0.75% <0.00%> (-73.92%)
:arrow_down:

src/stream.cpp
50.00% <0.00%> (-50.00%)
:arrow_down:

src/encodings.cpp
50.00% <0.00%> (-50.00%)
:arrow_down:

src/column.cpp
53.33% <0.00%> (-46.67%)
:arrow_down:

include/cppsas7bdat/column.hpp
53.33% <0.00%> (-43.55%)
:arrow_down:

src/exceptions.cpp
57.89% <0.00%> (-42.11%)
:arrow_down:

src/metadata.hpp
66.53% <0.00%> (-18.86%)
:arrow_down:

... and 17 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1cd2256...3009161. Read the comment docs.


Importing Gurobi_jll takes 1 minute

See https://github.com/jump-dev/Gurobi.jl/pull/565#issuecomment-2175384783
Something isn't right. I've asked @sebastianangerhausen for more information.

I'll debug in https://github.com/jump-dev/Gurobi_jll.jl/pull/23

julia> versioninfo()
Julia Version 1.10.1
Commit 7790d6f064 (2024-02-13 20:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Windows (x86_64-w64-mingw32)
  CPU: 8 × 11th Gen Intel(R) Core(TM) i7-1185G7 @ 3.00GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, tigerlake)
Threads: 1 default, 0 interactive, 1 GC (on 8 virtual cores)
Environment:
  JULIA_PKG_USE_CLI_GIT = true

It is a managed machine for work, so Julia was installed by our IT department. I could not observe anything special using the task manager.


Added sortType option to documentation and demo

-Added checkbox to toggle the sortType on the Sorting demo page
-Added sortType to README.md and defaults.js
For Issue #31

Closing to not include changes unintended commits.  Forked the wrong branch


license

Is the author interested in adding an open source license to the project? Thanks

Added to the latest version


Raylib won't make after I  type in the necessary commands

I type in  make PLATFORM=PLATFORM_DESKTOP GRAPHICS=GRAPHICS_API_OPENGL_21
in my raspberry pi terminal and nothing happens. It comes up with an error message saying:
In file included from external/glfw/src/internal.h:187:0,                  from external/glfw/src/context.c:28,                  from rglfw.c:54: external/glfw/src/x11_platform.h:33:22: fatal error: X11/Xlib.h: No such file or directory  #include <X11/Xlib.h>                       ^ compilation terminated. Makefile:499: recipe for target 'rglfw.o' failed make: *** [rglfw.o] Error 1

Do you have Xlib.h library installed in the system? It seems a user missing library issue.


about your other code 3DCrowdNet

Hello, I recently read your other paper, 3DCrowdNet. I was greatly inspired and wanted to ask you when this code will be open source. Thank you and look forward to your reply

Hi, thank your for your interest!
I prefer to release the codes after the paper get accepted, so I'm not sure when it will be...
But if many people want the codes to be released, I will think about it.

Hi, thank your for your interest! I prefer to release the codes after the paper get accepted, so I'm not sure when it will be...
But if many people want the codes to be released, I will think about it.

okey，thank you，it‘s  really a exciting work in human pose and shape estimation, Here, on behalf of Railway University, I pay tribute to your work. My team and I look forward to your open source code. I wish you a smooth scientific research

Hi, thank your for your interest! I prefer to release the codes after the paper get accepted, so I'm not sure when it will be...
But if many people want the codes to be released, I will think about it.

OK, thank you very much for your reply. I think your method in pose and shape estimation is very novel and creative. I believe many people are willing to see your code open. Here, on behalf of Railway University, I salute you and wish you a smooth scientific research

I appreciate your kind words:)


Compatibility mode

It might be useful to offer a command line flag (or per bot setting?) to have the API serve the updates conform to the standard, to make integrations with libraries as seamless as possible, and increase the drop-in ability.

This API is completely backwards compatible to the original bot api. Adding new stuff shouldn't break any library cause Telegram adds new objects all the time and just mentions them later in their changelog, we just shouldn't add any breaking changes.

Is not like we made breaking changes, i don't think that adding new fields would break anything

Okey, just wanted to have brought that up.


[Feature] - Localization

We will support localization. By default, it's Chinese. If user agent indicates it's English or other languages, we use English.

Won't implement, as it's over design for now.


SnackBar's show behind the keyboard

Not sure if they're supposed to sit above the keyboard or what?  Or maybe we're supposed to use a different widget when the keyboard is visible?
I discovered this by entering an invalid number in the fitness app.

FWIW, Android won't tell you whether the keyboard is visible.
So in general the application is left with deciding how it wants to deal
with incursions into its space by an IME or other parts of the system UI
based on other information provided during layout, particularly the content
insets.
The Android window manager provides the application with content inserts
which represent what part of the window will be visible.  The app may be
able to draw outside of that region but what it draws there may or may not
be visible since it might be covered by decorations like the status bar but
that's how translucent decorations work.  Typically the app will adjust its
content view's layout to fit that region (the framework can do this
automatically).
If you've got a snack bar, you'll want to anchor it to the bottom of the
content region of the window.
It may help to think of the app's layout as having both an outer decor part
(which contains the background and decor elements like the title bar which
fill the window) and an inner content part (which fits within the decor and
adjusts as the content region changes).
NB. I might be getting the details slightly wrong.  There are also
affordances for things like overscan regions but I think most of that is
hidden from the API.
See also:
https://developer.android.com/reference/android/view/View.html#setFitsSystemWindows(boolean)
On Tue, Aug 25, 2015 at 1:39 PM Eric Seidel<EMAIL_ADDRESS>wrote:

Not sure if they're supposed to sit above the keyboard or what? Or maybe
we're supposed to use a different widget when the keyboard is visible?
I discovered this by entering an invalid number in the fitness app.
—
Reply to this email directly or view it on GitHub
https://github.com/domokit/sky_engine/issues/810.


[DIGITAL STRATEGIST]: Applied Digital, AIOps/Turbonomic

Description
I work as a digital strategist on the Applied Digital team for AIOps. All of the heat maps that I have been trying to create have not been coming out right. I had started a ticket with Chris Albrecht/ServiceNow and got directed to this team instead.
The guidance that I have received is that something was blocking the CSS.
I have attached an image of how the heat maps are generating.

Component(s) impacted
Hotjar heat maps

Browser
Firefox
Carbon for IBM.com version
Not sure
Severity
Severity 4 = The problem is not visible to or noticeable to an average user. Affects minor functionality, no workaround needed.
Application/website
/cloud/aiops, /cloud/turbonomic
Package
@carbon/ibmdotcom-web-components
CodeSandbox example
Not sure how to answer
Steps to reproduce the issue (if applicable)
Generate a heatmap for /cloud pages
Release date (if applicable)
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct
[X] I checked the current issues for duplicate issues

Hey Jeff, do you have any new updates about Hotjar?

Their team is looking into adding support for adopted stylesheets, which they rolled into their mid November roadmap to start development.

Awesome, thank you!

Moving to sprint 24. Will followup with the hotjar dev team on Monday.

Hey Jeff, has there been any progress on adding support for adopted stylesheets?

Hi @kendallcarpenter ,
I received notice that the hotjar team will be activating first load support in the coming days!
They are still working on an incremental update that will allow for dynamic updates of adoptedStylesheets which will be going into Q1 (tentatively of the new year).

@jeffchew Awesome, thanks for the update! What exactly is first load support?

@kendallcarpenter it pretty much means whatever loads when the page first loads will be captured by hotjar.

@jeffchew Gotcha, thank you!

@kendallcarpenter just a heads up, the initial fix should be deployed now for Hotjar! Can you verify if you're seeing the changes?

@jeffchew For sure. Let me set up a new manual heatmap and I will respond with the results!

@jeffchew Looks like I am still having issues with the manual heat maps. I tried it out on /cloud/aiops and /cloud/turbonomic

@jeffchew Hey Jeff, were other people who were testing out the changes still having issues or was it only me?

Hi @kendallcarpenter !
I heard back from the Hotjar team, they actually said that they will be retiring manual heatmaps in the near future, and that it should be working for Recordings and Continuous Heatmaps. Can you check if it works fine in there?

Hey @jeffchew! Thank you for the update on manual heatmaps. I just checked on the continuous heat maps. It looks like they are having some issues, too. I'm attaching the one for www.ibm.com/cloud/aiops for reference!

Nothing shows up for the tablet version and this is what I got for the mobile version

@kendallcarpenter I was informed that the hotjar team made some improvements to continuous heatmaps in the past few weeks. Can you check to see if things look better now?

Just checked on continuous. Here is what I see for /cloud/turbonomic!
I also recently got an email from the Hotjar support team that said the following -
_Hey Kendall,
Thanks for reaching out and sorry to hear about the issue with your Recordings.
I took a look into this, and I could see that when I'm trying to re-take your Screenshot, I'm seeing "Error 413: Request Entity Too Large" in my Console view.
The 413 error is occurring when we're trying to open a connection between the user/client session, and our Hotjar servers. The problem is that the content we're trying to retrieve from that page is larger than our current limit 🙁
For some additional context, the way Hotjar works is that we pass data from the user's session through our WebSocket. We are collecting the DOM elements and any mutations, plus any events related to click and scroll—these are used to rebuild the session as a web page.
For performance (both on our end, and for the user) we request larger data payloads (so images, CSS, etc.) separately and we cap what can be sent through the WebSocket. If assets are added right into the DOM, the page may bloat up a little and cause 413 errors.
The hard limit we have right now is 10MB. We've reviewed this in the past, but currently, we're not comfortable with raising the limit any higher.
I wouldn't assume to ask you to refactor the page to support Hotjar, however, it might be worth having a look at the code and see if there's any room for optimization, and if there are styles added to the page itself that could be loaded as separate assets. The page itself is 11MB in size, for reference.
Of course, I do appreciate that this approach has been chosen for good reasons during production and I'd be happy to learn more about the approach taken if you feel that our limits are not appropriate for contemporary development.
I hope this helps. Please let me know if I can clarify anything, or if you have any other questions 😊.
Cheers,
Alex Bakke | Technical Support_

@kendallcarpenter just checking in! Has the use of dynamic heatmaps been helpful to get around this?


Wrong param order of  paramalized update actions

An update action like this
def mutate = quote { (userId: Int, totalFee: Int) =>
    query[User].filter(_.id == userId).update(_.remain -> totalFee)
}

Its statement is
update table user set remain = ? where id = ?

If we invoke db.run(mutate)(List(1, 10000)) then it will pass (1, 10000) to the statement, actually it should be (1000, 1)

@fwbrasil This is a serious bug. Could have a look at it?

Sure, I'm working on it. Should have a fix today.

@jilen Could you test it on 0.2.2-SNAPSHOT?


[swift/API] TransactionRecord

tracking issue for missing fields / methods in TransactionRecord

[ ] transactionId should be a TransactionId
[ ] contractFunctionResult
[ ] transfers
[ ] tokenTransfers
[x] ~tokenTransferList~
[ ] tokenNftTransfers
[ ] assessedCustomFees

Note: Once both #304 and #308 are merged, this will be done


Performance issues - Prerelease 4.0.0-ci124

Trying to isolate a performance issue in the new pre-release.  Rechecked that it wasn't config on my old machine by reverting to 3.1.2-beta109.
At least every half a seconnd I get a 200ms frame rate spike in the new pre-release. Stepping through code doesn't seem to show the origin of the issue.  Will continue to investigate, but definitely found the issue was gone when reverting to 3.1.2 version.
Running this in Visual Studio 2017 Community Edition.

Which API are you using? Are you sure that you have proper Dispose() on each SharpDX objects? This 200ms spike looks like a GC problem...  I'm not aware of a change in the API that would introduce this...

I've got more of an update, just installed Ci141 and now spammed with alot of warnings to the console.
Warning: Live ComObject [0x215C280D320], potential memory leak:
Went back and installed ci124 and same thing has been happening.  I didnt have my output view viewable so i wasnt seeing all these.  Is this a new warning level?    Anyway of lowering the noise on this?  Or debugging exactly how to find why the warning is occurring?
Please close, I now know the source of the performance issue, its verbose warnings coming from the package.

Also, the debug warnings dont appear if you just step through the code slowly.

As you can see, this warning is coming from ComObject.Dispose
It depends on the default Configuration:

EnableReleaseOnFinalizer: false by default. If true, it will allow ComObject to be automatically released by the finalizer.
EnableTrackingReleaseOnFinalizer: true by default. If true, it will display the above warning if EnableReleaseOnFinalizer was false

The idea behind these switches is that SharpDX expects by default that you explicitly Dispose() all ComObjects. If you are getting a warning (without modifying the code), it means that you have an object that was not correctly disposed manually.
You use ObjectTracker to find the original stacktrace of the allocated ComObject (ObjectTracker.ReportActiveObjects()). If the stacktrace is incomplete, you might try to provide your own stacktrace via ObjectTracker.StackTraceProvider (and use something like new StackTrace(new StackFrame(true)).ToString()

Interesting, in 3.1.1 I assume this was less verbose.  Thanks for info.

Well this is getting weird, I was dumping the objects out to a file.
Im getting a number of references to the immediate context and the device being allocated.  This get's weirder.  I commented out my game logic, leaving an empty logic loop and render loop.  It still keeps leaking references, but im not running any code in the loop.
frame - 1326
Count per Type:
BlendState1 : 4
Buffer : 681
DepthStencilState : 2
DepthStencilView : 1
Device : 754
Device3 : 0
DeviceContext : 0
DeviceContext1 : 4
DeviceContext2 : 0
DeviceContext3 : 0
DirectInput : 0
DomainShader : 0
GeometryShader : 1
HullShader : 0
InfoQueue : 0
InputLayout : 7
Joystick : 0
Keyboard : 0
Output : 1
PixelShader : 9
RasterizerState1 : 1
RenderTargetView1 : 1
SamplerState : 13
ShaderResourceView1 : 7
SwapChain3 : 0
Texture2D1 : 1
VertexShader : 7
Frame 1838

Again, it is unlikely a problem in SharpDX but solely in your code. Their are lots of objects that can be created without noticing (properties access, QueryInterface...etc.). With the ObjectTracker as described in the other issue, you should be able to recover where all these references are created.

Actually I tracked the problem down and its when I use reflection to enquire on the object be it either device or context.
   for (int i = 0; i < list.Count; i++)
    {
                SharpDX.Diagnostics.ObjectReference item = list[i];
                string a = item.StackTrace;
                if (item.Object.IsAlive)
                {
                    object reference = item.Object.Target;
                    file.WriteLine(reference.ToString());

                    foreach (var prop in reference.GetType().GetProperties(BindingFlags.Public | BindingFlags.Instance | BindingFlags.NonPublic))
                    {
                        try
                        {
                            string aa = prop.Name + " " + prop.GetValue(reference, null);
                            file.WriteLine(aa);
                        }
                        catch
                        {
                            file.WriteLine("Exception");
                        }
                    }
                    file.WriteLine("------------------------------------------------------------------");
                }
            }

Will close issue as original item is answered.  Reflection issue needs more investigation.

Reflection issue needs more investigation.

Not sure what you are looking for, but as I mentioned previously, using reflection on SharpDX ComObject will query properties that may create new ComObject, a reason why displaying them in via ObjectTracker would feed back the ObjectTracker.


[HUDI-1415] Incorrect query result for hudi hive table when using spa…

…rk sql
Tips

Thank you very much for contributing to Apache Hudi.
Please review https://hudi.apache.org/contributing.html before opening a pull request.

What is the purpose of the pull request
If we update a hudi table twice more, we will get an incorrect query result by spark sql. There are many duplicate record in the results. This PR is trying to fix this issue.
Brief change log

Support sync tableProperties & serdeProperties to Hive table  in HiveSyncTool.
Add new method in AbstractSyncHoodieClient to support sync table properties.
Add the extra table properties & serde properties need for spark datasource table in HoodieSparkSqlWriter
when sync meta to hive.

Verify this pull request
This change added tests and can be verified as follows:

Added HoodieSparkSqlWriterSuite to verify the change.
Added TestHiveSyncTool#testSyncWithProperties  to verify the change.
Manually verified the change by running a job locally.

Committer checklist

[x] Has a corresponding JIRA in PR title & commit

[x] Commit message is descriptive of the change

[ ] CI is green

[ ] Necessary doc changes done or have another open PR

[ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.

Codecov Report

Merging #2283 (767642c) into master (56866a1) will decrease coverage by 43.15%.
The diff coverage is n/a.

@@              Coverage Diff              @@
##             master    #2283       +/-   ##
=============================================
- Coverage     53.56%   10.41%   -43.16%
+ Complexity     2774       48     -2726
=============================================
  Files           348       50      -298
  Lines         16117     1777    -14340
  Branches       1641      211     -1430
=============================================
- Hits           8633      185     -8448
+ Misses         6785     1579     -5206
+ Partials        699       13      -686

Flag
Coverage Δ
Complexity Δ

hudicli
?
?

hudiclient
?
?

hudicommon
?
?

hudihadoopmr
?
?

hudispark
?
?

huditimelineservice
?
?

hudiutilities
10.41% <ø> (-59.66%)
0.00 <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ
Complexity Δ

...va/org/apache/hudi/utilities/IdentitySplitter.java
0.00% <0.00%> (-100.00%)
0.00% <0.00%> (-2.00%)

...va/org/apache/hudi/utilities/schema/SchemaSet.java
0.00% <0.00%> (-100.00%)
0.00% <0.00%> (-3.00%)

...a/org/apache/hudi/utilities/sources/RowSource.java
0.00% <0.00%> (-100.00%)
0.00% <0.00%> (-4.00%)

.../org/apache/hudi/utilities/sources/AvroSource.java
0.00% <0.00%> (-100.00%)
0.00% <0.00%> (-1.00%)

.../org/apache/hudi/utilities/sources/JsonSource.java
0.00% <0.00%> (-100.00%)
0.00% <0.00%> (-1.00%)

...rg/apache/hudi/utilities/sources/CsvDFSSource.java
0.00% <0.00%> (-100.00%)
0.00% <0.00%> (-10.00%)

...g/apache/hudi/utilities/sources/JsonDFSSource.java
0.00% <0.00%> (-100.00%)
0.00% <0.00%> (-4.00%)

...apache/hudi/utilities/sources/JsonKafkaSource.java
0.00% <0.00%> (-100.00%)
0.00% <0.00%> (-6.00%)

...pache/hudi/utilities/sources/ParquetDFSSource.java
0.00% <0.00%> (-100.00%)
0.00% <0.00%> (-5.00%)

...lities/schema/SchemaProviderWithPostProcessor.java
0.00% <0.00%> (-100.00%)
0.00% <0.00%> (-3.00%)

... and 323 more

@pengzhiwei2018 would you please describe in more details about the issue?

@pengzhiwei2018 would you please describe in more details about the issue?

@pengzhiwei2018 would you please describe in more details about the issue?

Hi @leesf ,Sorry for the late response. I find that when reading hudi table using spark sql when SparkSession#enableHiveSupport is true, the query result is incorrect with many duplicate records. After debugging, I found out that the reason is that it miss some table properties and serde property in the hive table metadata. Spark sql just treat the table in hive as a hive table, but not a hudi datasource table.And finally, spark sql read the hudi table as a normal parquet table, which lead to the duplicate records in query result.
I fix this issue by add the missing table properites and serde properties to the hive table.The missing table properties are here:
spark.sql.sources.provider= 'hudi' spark.sql.sources.schema.numParts = 'xx' spark.sql.sources.schema.part.{num} ='xx' spark.sql.sources.schema.numPartCols = 'xx' spark.sql.sources.schema.partCol.{num} = 'xx'
and the missing serde properties is: 'path'='/path/to/hudi'
With this fix, the spark sql can read the hudi table in hive meta correctly Now.

Currently the test case is block by this issue https://issues.apache.org/jira/browse/HUDI-1484 which was found by this PR.
I will solve the HUDI-1484 soon.

I had the same problem, but I saw less rows not more.
Reading with spark datasource I have more than 30 million rows and using spark sql with hive only 4 million.
I had this problem only these two options are enabled
"spark.sql.hive.convertMetastoreParquet": "false"
"spark.hadoop.hoodie.metadata.enable": "true"
@pengzhiwei2018

I had the same problem, but I saw less rows not more.
Reading with spark datasource I have more than 30 million rows and using spark sql with hive only 4 million.
I had this problem only these two options are enabled
"spark.sql.hive.convertMetastoreParquet": "false"
"spark.hadoop.hoodie.metadata.enable": "true"
@pengzhiwei2018

@pengzhiwei2018 : once you have addressed all comments, do let me know. so that I can review again.

@vinothchandar @n3nash : for spark sql, just setting "spark.sql.hive.convertMetastoreParquet": "false" should suffice right. Is there any other config that we need to set. I guess this PR should not be required in the first place. can you folks check it out. https://issues.apache.org/jira/browse/HUDI-1415

@pengzhiwei2018 : I got a chance to sync up w/ Vinoth and Balaji. Now, I get the intention with this PR. Sorry about the noise. I will take a look in a day or two. But expect either of Vinoth or Balaji to review it as well as they have more expertise w/ perf nuances.

I do understand that these properties should be synced because it will make the spark sql queries go through the Data source instead of input format right ? So after this change spark sql will not go through the input format right but instead go through the datasource implementation ? This is needed either ways, but just want to confirm my understanding. @nsivabalan @vinothchandar
But "incorrect results" thing is not correct because Hudi requires you to use the convert metastore property to false when querying via spark sql. And if you set it to true (default) you need to use the path filter.

I do understand that these prope

Hi @umehrot2
#I do understand that these properties should be synced because it will make the spark sql queries go through the Data source instead of input format right ?
Yes, you are right! Spark DataSource need these properties sync to hive meta.
#But "incorrect results" thing is not correct because Hudi requires you to use the convert metastore property to false when querying via spark sql. And if you set it to true (default) you need to use the path filter.
Thanks for you correct. I will rename the description of the title.

@pengzhiwei2018 : I got a chance to sync up w/ Vinoth and Balaji. Now, I get the intention with this PR. Sorry about the noise. I will take a look in a day or two. But expect either of Vinoth or Balaji to review it as well as they have more expertise w/ perf nuances.

Thanks for your attention on this issue, @nsivabalan . I will also spend some time to fix the test case and solve other comments in the CR.

@pengzhiwei2018
1、Now when use spark sql query hudi, need set "spark.sql.hive.convertMetastoreParquet=false" https://hudi.apache.org/docs/querying_data.html. But it is confused, many user maybe forget it .
2、If spark read the table use datasource have a big advantage:
hive meta will be very light, the partition list and schema do not need to visit hive meta. How does databricks delta do ?
3、I suggest to persist the properties to hudi metatable. Hive meta just persist the table name and database name . May be we can research  delta lake.

@pengzhiwei2018 @nsivabalan @vinothchandar
1、Now when use spark sql query hudi, need set "spark.sql.hive.convertMetastoreParquet=false" https://hudi.apache.org/docs/querying_data.html. But it is confused, many user maybe forget it .
2、If spark read the table use datasource have a big advantage:
hive meta will be very light, the partition list and schema do not need to visit hive meta. How does databricks delta do ?
3、I suggest to persist the properties to hudi metatable. Hive meta just persist the table name and database name . May be we can research delta lake.

Agree with 1 and 2. Currently spark read delta as datasource table too.
For question 3, Currently spark need this properties when read meta data from the meta store, So we should persist these properties there.  If just persist these properties to the hudi metatable, there need same change to the spark code to support this, I think.

Hi @nsivabalan @umehrot2 can you take a review on this pr again?

#2651 is now merged. @umehrot2 @pengzhiwei2018 what are the next steps for this PR?

@pengzhiwei2018 @vinothchandar dropped one comment. Otherwise LGTM. Also seems like it has conflicts now. I can merge it once its cleared out.

Hi @umehrot2 @vinothchandar The PR has updated to solve the last comment, Please take a review again~

This is a great contribution. Thanks @pengzhiwei2018 !

great job on the patch 👍


Dynamic Programming

Title - Count number of unique paths to reach end of matrix starting from 0th pos
what will change -  Code
Type of Issue -  Approach
Please add/delete options that are not relevant.

[x] Adding New Code
[x] Improving Code
[x] Improving Documentation
[x] Bug Fix

Programming Language
Please add/delete options that are not relevant.

[x] Python
[x] C++
[x] Java
[x] C
[x] Go
[x] Other language

Self Check

Ask for issue assignment before making Pull Request.
Add your file in the proper folder
Clean Code and Documentation for better readability
Add Title and Description of the program in the file

:star2: Star it :fork_and_knife:Fork it :handshake: Contribute to it!
Happy Coding,

please assign me for this task @div-bargali  @jai2dev


Facing issue on inferrence

Hi I am trying to run the for the demo purpose of your pretrained and provided files. however upon execution of the command:
"python inference.py --config configs/inference.yaml --video_source=./docs/demo/videos/RD_Radio34_003_512.mp4 --image_source=./docs/demo/images/100.jpg --cross_id --output_dir=./docs/demo/output"
I am facing the following error.
Stage: inference
Load pre-trained StyleHEAT [net_G_ema] from checkpoints/StyleHEAT_visual.pt done
0%|                                                                                | 0/1 [00:05<?, ?it/s]
Traceback (most recent call last):
File "inference.py", line 219, in
main()
File "inference.py", line 202, in main
data = dataset.load_next_video()
File "D:\rt_faceSync\styleheat\StyleHEAT\data\inference_dataset.py", line 174, in load_next_video
video_data = self.data_preprocess(video_path, image_path)
File "D:\rt_faceSync\styleheat\StyleHEAT\data\inference_dataset.py", line 118, in data_preprocess
source_3dmm = self.model_3dmm.get_3dmm([src_image_pil_256]

add --if_extract

Thanks working now

@FeiiYin @ccyyatnet can you please tell me how to inference on audio driven lip movement generation?


cache response is stale

Hi, it seems like the cache response contains the old response while the network response is new and modified.
We're on android using  'com.squareup.okhttp3:okhttp:3.11.0'
See example below of the headers we get this in the same Response, notice the network response has 200 status code and a newer LastModified, different ETag etc.
The expected result would be that the cache response would contain the same (new) data as the network response in cases where the network response is fresher.
network response
Response{protocol=http/1.1, code=200, message=OK, url=http://xxx.yyy.zzz/test}
headers: Content-Type: application/octet-stream
Content-Length: 3093384
Connection: keep-alive
Date: Mon, 07 Jan 2019 09:11:45 GMT
Last-Modified: Mon, 07 Jan 2019 09:11:15 GMT
ETag: "18905c1f58feca0c6df495f7cc2e6846"
x-amz-version-id: 6J9k_vF2g.lPoELovv9G.rUPpfnk2h4r
Accept-Ranges: bytes
Server: AmazonS3
Age: 10
X-Cache: Hit from cloudfront
Via: 1.1 32c8da10203574baccb74b8f771a7ffb.cloudfront.net (CloudFront)
X-Amz-Cf-Id: FVvnNF3QD5I0vELy78FoVxYgvJeqRsCACGdbbh5W8MGtARkg0lH9CQ==
cache response
Response{protocol=http/1.1, code=200, message=OK, url=http://http://xxx.yyy.zzz/test}
headers: Content-Type: application/octet-stream
Content-Length: 3093323
Connection: keep-alive
Last-Modified: Sun, 06 Jan 2019 15:03:31 GMT
Accept-Ranges: bytes
Date: Mon, 07 Jan 2019 09:09:11 GMT
ETag: "9725f2a6b04151c54f8a420be6fa7690"
x-amz-version-id: vKJV3auEiruTggNKvciHJoy1LWscENFM
Server: AmazonS3
Age: 65063
X-Cache: Hit from cloudfront
Via: 1.1 e64eb476d8f76c461d21278e018e194f.cloudfront.net (CloudFront)
X-Amz-Cf-Id: R53ZU9rO1_ZWlueMU3Xo1ZOeDX5ibAv9TFDgp2uchC6rfg9fBCtk-A==

Good idea!
https://github.com/square/okhttp/issues/4637


Comments for Raspberry Pi Time-Lapse Camera Pt 1

2 issues URGENT

You linked here from both part 1 and part 2
Part 2 video is as corrupt as Joe Biden

Yes thank you thank you. I'm actually aware of both problems but haven't written any code all week due to Thanksgiving / school closure.
I actually need to tweak the video format anyway because apparently mp4 isn't supported by Firefox. Maybe webm? Is that legit for safari?

Unfortunately, no dice on webm in Safari. That can't be correct about .mp4, your part 1 vid is working for me in Firefox. I'm on MacOS if that makes a difference.

I think the real answer is probably finding a peertube instance then. 🙃

Unfortunately, no dice on webm in Safari. That can't be correct about .mp4, your part 1 vid is working for me in Firefox. I'm on MacOS if that makes a difference.

The video should be working again. I've decided that the ability to maintain a conversation across multiple posts is a feature and not a bug.

Sure, no issue having comments shared as long as it's intentional.
I'm able to see the video in Chrome, which I actually don't think I tried before because I hate Chrome. But it's still broken in Firefox (and Safari as expected). FF says "No video with supported format and MIME type found"


MGDCTRS 757: Update the eval registration

Closes issue : https://issues.redhat.com/browse/MGDCTRS-757

Show the different alert types based on eval namespace duration remaining (shown only when eval namespace is selected).
Updated the eval namespace to have a unique short UUID
Enabled the namespace list polling to update the namespace state in the UI
More than 24 hr

less than 24 hr

Less than 3 hr

Hey @heiko-braun @jgiardino let me know if the above mention time period to show the "info", "warning" and "danger" type alert msg is fine.

Looks good to me.


Update math.vector.ts

Adds static "CenterToRef" for Vector2/3/4

We are in code freeze so we can only merge bug fixes
I will merge this PR as soon as 4.2 will be out :)

Github giving problems :)
https://github.com/BabylonJS/Babylon.js/pull/9406


Execute in new tab: create a new tab if current query processor has jobs running

When the user issues an "Execute in new tab" command, we need to check if the current query processor is running a query. If it is, we want to create a new tab.

this is an attempt to fix https://github.com/dbeaver/dbeaver/issues/9008

@mlazatinph Thanks!


Azure ManagedIdentityCredential

I have been developing a project for a client using Dask. One key element is accessing data from their Azure Data Lake Storage. Many routes are available to authenticate to ADLS, but unfortunately the route preferred at this client (and often by Enterprise clients) is the ManagedIdentityCredential. This authentication mechanism doesn't appear to work with Dask.
https://docs.microsoft.com/en-us/python/api/azure-identity/azure.identity.managedidentitycredential?view=azure-python
Is there anything stopping it from working / being implemented through storage_options, whereby we simply present a valid credential (or perhaps a function so that each machine in a cluster can request the ManagedIdentityCredential associated with that machine)?

Works for me. If you want more useful feedback you should post the code you tried and the error that resulted.
xref: https://matthewrocklin.com/blog/work/2018/02/28/minimal-bug-reports

Oh, I didn't realise it was meant to work. Some code that fails (although you'll need your own AD, ADLS and file to test it out on):
from azure.identity import ManagedIdentityCredential client_id = '<client_id>' resource = '<account name>' mi_cred = ManagedIdentityCredential(client_id=client_id) storage_options = {'account_name': resource, 'credential': mi_cred} ddf = dd.read_fwf('abfs://<bucket>/<path_to_file>',                               colspecs=colspecs,                               storage_options=storage_options )
I get an error:
"TypeError: object AccessToken can't be used in 'await' expression."
I'm using dask version 2021.03.0 and adlfs v.0.7.1.

fsspec uses async operations so you need to import the async version of the token - try:
from azure.identity.aio import ManagedIdentityCredential

NB: There was some bug I ran into with adlfs <0.7.3 so I'd update to at least that version

Hmm, OK. I get some kind of serialisation error. Let me dig a big further and will report back success or further code illustrating what I find.

may also want to post at https://github.com/dask/adlfs/issues?q=is%3Aissue+is%3Aopen+sort%3Aupdated-desc given that dask IO using abfs/az will get parsed through there.


How do I convert a Thing into a more specific RedditSharp object (like Comment)?

Hi, just wondering how to do what the title says. I'm pretty much trying to turn comment.Parent (comment is an instance of RedditSharp.Things.Comment) of type RedditSharp.Things.Thing into an object of type RedditSharp.Things.Comment. I'm assuming there is probably some async function I need to call somewhere to convert it? Or use its fullname? I really don't know. Any help is appreciated :D

Oh I can't check now but I had an idea. Don't tell me you can just add a (Comment) :/

That works in theory but now comment.Parent returns null. Anyone know why?

Ok I'm going to close this issue. I'm not sure why it is returning null, but I found a way around it by doing (Comment)await reddit.GetThingByFullnameAsync(comment.ParentId)

Yup, casting it to the correct type is what you'd want to do. Because the parent could either be a comment or a post, it'll return the more generic Thing. You can then check the type with something like
var p = await reddit.GetThingByFullnameAsync(comment.ParentID);
if(p.GetType() == typeof(Comment)) { //do something }


importing latest changes from upstream locust

This will be followed in #3

This will be followed in #3


Memory leak nodejs

Memory leak all over the place

need reproduceable code, and possible the node version u are using


Delete tutorial/09_qt directory

Overview

Delete tutorial/09_qt directory

Details

Move the Qt section to trame.

I still feel that we need a qt section, at least a brief mention to show how you can use PyVista. MNE, my femorph library, and several others use pyvistaqt and QT isn't going away anytime soon. I fully support the usage of Trame, but desktop applications are alive and well for CAE.

Copy. I will rewrite it in that policy.

On second thought, I let's remove this section. I do think it should be mentioned, but we don't need a full section.

I would integrate the Qt description into the Action section.


supporting: add debounce and distinct ability to Binding

Codecov Report

Merging #15 (d742706) into main (ae6c210) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff            @@
##             main      #15    +/-   ##
========================================
  Coverage   99.96%   99.96%
========================================
  Files          52       56     +4
  Lines        5337     5475   +138
========================================
+ Hits         5335     5473   +138
  Misses          2        2

Impacted Files
Coverage Δ

Sources/AsyncStateMachine/AsyncStateMachine.swift
100.00% <ø> (ø)

Sources/Supporting/Inject.swift
100.00% <ø> (ø)

Sources/Supporting/ThrowingInject.swift
100.00% <ø> (ø)

Sources/Supporting/AsyncBufferedChannel.swift
100.00% <100.00%> (ø)

Sources/Supporting/Binding+Debounce.swift
100.00% <100.00%> (ø)

Sources/Supporting/Binding+Distinct.swift
100.00% <100.00%> (ø)

Tests/Supporting/Binding+DebounceTests.swift
100.00% <100.00%> (ø)

Tests/Supporting/Binding+DistinctTests.swift
100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


remove ARM64 support on k8s/VMs STO-6969

Harness Developer Pull Request
Thanks for helping us make the Developer Hub better. The PR will be looked at
by the CODEOWNERS.
What Type of PR is This?

[ ] Issue
[ ] Feature
[ ] Maintenance/Chore

If tied to an Issue, list the Issue(s) here:

Issue(s)

House Keeping
Some items to keep track of. Screen shots of changes are optional but would help the maintainers review quicker.

[ ] Tested Locally
[ ] Optional Screen Shoot.

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://65a6c013d410ec008d67f088--harness-developer.netlify.app

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://65a6c5063edb8704df282e14--harness-developer.netlify.app


Remove non specific code for windows/nix

What does this PR do?
This PR removes windows specific code
Motivation
Now that openFile doesn't block the file on Windows, we can reuse a lot of the Unix tailer code

🎉


Support for proxy - manager31

This pull request adds support for proxy in the test suite.
It is incomplete, i.e. it stops at using the proxy for the trad client and the salt minion. The other bootstraps have not been modified yet. This will be done in some other PR.
The test suite behaviour is left unchanged if shell variable PROXY is not set.

Bug with the extraction of /tmp/spacewalk-debug.tar.bz2 is now fixed. We can merge.


A lot of styling isnt working

https://pastebin.com/PtRmtZ96

It looks like there are multiple issues at play here.
First off, the tool is unable to load the configuration. Could you make sure that config.json is present in ...\league-prod-toolkit-develop\modules\config and doesn't contain any syntax errors? (feel free to post your config here with the API key redacted and I will take a look.)
The theming not working probably isn't config-related. Please try manually reapplying the default (or your) theme in the theming module. If you are using a customised theme, please post your index.scss here so I can take a look :)

So I reapplied the theme and it works now, thanks for that. And I also somehow without actually doing anything fixed the modules/plugins:

However, I've found out that saving doesn't work for me; in rcv-teams I set the names and tags for the teams but when I go to the page it says Its still plain white (except for the yellow VS etc.) (Also applies rcv-tournament-tree, rcv-caster (When I click add it doesn't do anything)

Also, there are some errors happening in the console:
https://pastebin.com/HV5DN1NT

UPDATE: It all works now :D


DOM injected in X3DCanvas after x_ite_dom is load is not processed

I came along this bug while I checked the D3 examples, but https://raw.githack.com/jamesleesaunders/d3-x3d/master/examples/X_ITE/chart/ParticlePlot.html does sometimes not load. This happens especially in Chrome. If it takes to long to load the CSV then x_ite_dom is already loaded and first then d3 adds X3D DOM elements to the X3DCanvas, but these are not processed.
The script in the HTML page outputs a 'done' to the console when finished. If that 'done' comes after 'X_ITE XHTML DOM integration enabled' output from x_ite_dom, then the canvas left black.

Ok, hm. I am not sure I understand the timing completely. Perhaps it is a matter of mutations.
The sequence probably is:

xite_dom sees the empty the X3DCanvas and starts to observe it.
d3-x3d loads the csv in the promise
I think when it is done loading, the promise is fulfilled, and the chart dom is generated
I think the chart dom is inserted and then mutated for each added data point. I am not quite sure how x_ite handles parsing empty x3d elements.
It would be better if the chart dom would be completely generated outside of the X3DCanvas and only inserted once after it is complete. But d3 typically does not do this with svg. It is designed to update the current svg.
Finally, it says 'done'.

Using the debugger I found:

x_ite_dom expects a X3D element inside the X3DCanvas to start observing the element. The example does not have it. There was probably a reason why there is a check for an existing X3D element but I do not remember it.
x_ite_dom relies on the afterImport callback of the browser.importDocument SAI function to start observing. Not sure if x_ite calls the callback after importing an empty X3D element; ok, it does.

@jamesleesaunders: here is a more robust way to dynamically construct the x3d:
<X3DCanvas id="chartholder" style="width: 500px; height: 500px;"><X3D></X3D></X3DCanvas>

The Bell Labs Pollen data set: In the 1980s, the ASA (American Statistical Association) held a data competition challenged contestants to find as many features as possible in a 5 dimensional data set of 4000 cases. Among other important (known) features in the data set, in a scatterplot of three of the dimensions, the word ’EUREKA’ was clearly apparent. Participants had a deadline, but were not timed; the number of insights or features identified by the contestants was used to judge the winner(s). (Handbook of Data Vis pg179)

Dahshan & Polys 2021

Available at: https://www.openml.org/d/529


Make push section of node script easier to inspect

Two changes:

Enable set -e before pushing so that failure to push fails the build
Print a message if diff is empty

Thanks. I don't remember why I even had that as set +e. I guess to not exit if there actually is a diff?

@tswast yeah that's the reason.


Update README.md

updated kotlintest version to the last one
added an hint to clean up configuration by old dependencies

:+1:


merge: dev to master

:tada: This PR is included in version 0.114.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


API/OS Specific Text Highlighting

I am a grad researcher with DePaul University in Chicago and we are using ComputerCraft to teach Lua to grade schools. The IDE is great but it would be nice if specific API functions were highlighted and if OS specific objects also had their own syntax highlight, e.g. turtle.select(1) would be some combo of colors. This seems easy enough given the highlight,lua would just need some additions. I'm more than willing to fork and submit a PR

@GravityScore said that he's happy with doing it himself (although he might not ever get to it, lol), I'm sure he'll also be fine with you submitting a pull request too. Feel free to fork, modify, and distribute LuaIDE however you want.

Thanks, I did some quick changes and it works for what I need it for though I think it needs a bit more vetting to make sure highlighting acts the way its supposed to. right now the way i set it up is that it doesn't check if a function is a part of the api that called it, just highlights keywords


How use Fairing on Kubeflow running on local cluster?

/kind bug
What steps did you take and what happened:
I'm trying to setup Fairing for onPrem cluster using Microk8s. Fairing documentation states that Fairing uses docker to build/push images. However, the custom Jupyter notebook doesn't seem to run docker daemon showing error Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running? whenever docker commands are used.
What did you expect to happen:
Fairing should work on local cluster's custom Jupyter notebook too.
Anything else you would like to add:
Is it possible to make a custom Jupyter image which can be used with Kubeflow? I managed to run Docker commands on the custom image running locally by bind mounting the volume to provide access to var/run/docker.sock from host system; i.e. using docker run -v /var/run/docker.sock:/var/run/docker.sock ...
How can such a thing be accomplished while running the custom Jupyter image from Kubeflow instead of running from host using docker run commands? Or is that incorrect approach/infeasible?
Environment:

Fairing version: (use python -c "import kubeflow.fairing; print(kubeflow.fairing.__version__)"): 0.7.0
Kubeflow version: (version number can be found at the bottom left corner of the Kubeflow dashboard): v1beta1
Minikube version:Running on Microk8s version 1.14
Kubernetes version: (use kubectl version):

Client Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.10", GitCommit:"575467a0eaf3ca1f20eb86215b3bde40a5ae617a", GitTreeState:"clean", BuildDate:"2019-12-11T12:41:00Z", GoVersion:"go1.12.12", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.10", GitCommit:"575467a0eaf3ca1f20eb86215b3bde40a5ae617a", GitTreeState:"clean", BuildDate:"2019-12-11T12:32:32Z", GoVersion:"go1.12.12", Compiler:"gc", Platform:"linux/amd64"}

OS (e.g. from /etc/os-release):

NAME="Ubuntu"
VERSION="18.04.3 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.3 LTS"
VERSION_ID="18.04"

NOTE: If you are using fair from master, please provide us the git commit hash.

I got the exactly the same issue after installing docker. It seems that there is some issue when installing docker inside a docker container, but don't know how to fix it. docker run -v /var/run/docker.sock:/var/run/docker.sock might be a workaround, but for my case is not ideal :(.

What about using append builder.
https://github.com/kubeflow/fairing/blob/7e4c23c47a6b0544a722d04e1f9910c2f283a4f6/kubeflow/fairing/builders/append/append.py#L20-L22
Does the small example included in https://github.com/kubeflow/fairing/issues/460 work for you?

Found the same error, maybe we can downgrade microk8s to 1.13, see this for detail: https://github.com/ubuntu/microk8s/issues/382

In case you want to do quick tests with fairing on microk8s, here is a dirty way to fix it @tarun0, @DdMad

Please downgrade your microk8s to 1.13 for docker command (see https://github.com/ubuntu/microk8s/issues/382)
Fairing has hard coded docker-py to read local '/var/run/docker.sock' for docker client, hence
need to create soft links for microk8s (see https://github.com/kubeflow/kubeflow/issues/2347)
ln -s /var/snap/microk8s/common/var/lib/docker /var/lib/docker
ln -s /var/snap/microk8s/current/docker.sock /var/run/docker.sock
Fairing uses local '~/.kube/config' to deploy jobs, need to create that file for microk8s by runing
mkdir -p ~/.kube
microk8s.kubectl config view > ~/.kube/config

And then I can build and deploy the job:

What about using append builder.
https://github.com/kubeflow/fairing/blob/7e4c23c47a6b0544a722d04e1f9910c2f283a4f6/kubeflow/fairing/builders/append/append.py#L20-L22
Does the small example included in #460 work for you?

@marcindulak Append builder is also working for microk8s v1.13, but not working for 1.14 and higher.


WFLY-13627 Distributed sessions/SFSBs stored in non-transactional invalidation-cache should schedule expirations locally

https://issues.redhat.com/browse/WFLY-13627

We are doing EAP 7.3.2.CR2 and need to include some critical issues. Can we get this issue merged upstream so we can include it in CR2? Thanks!


Fixing resolver settings, and unexpected behavior

Heyo,
I was playing around with subfinder (installed via go get), and I noticed that non-resolvable subdomains were returning a phony ip address of <IP_ADDRESS>. This was weird, because I've successfully used the v1 release binary in the past.
It turns out <IP_ADDRESS> belongs to Search Guide Inc which is a dns hijacking service for advertisements. Apparently level3 is a shitty citizen of the internet, and they redirect non-resolvable requests to a third party advertising/searchengine service...
Therefore I propose we remove level3 from the default set of resolvers; as it breaks dns brute forcing by returning false-positives for every unresolvable subdomain.

Additionally I discovered the above side effect because subfinder was ignoring the resolver ip addresses I was passing in via -r/-rL. It looks to me as this was a simple copypasta typo that occurred during a recent refactor: https://github.com/subfinder/subfinder/commit/29b85aec89f2ec24feec39fd896a5d08e2482dfd#diff-7ddfb3e035b42cd70649cc33393fe32cL161

I've addressed both of these issues in two separate commits within this pull request. Please let me know if I need to change anything to get merged.

Thank-you for this - took me a few hours to confirm the finding and that there were no unintended side affects, but I agree with this change.


Update ol

This updates ol to the latest version.
Since the peer dependency of ol is updated as well, this is treated as a breaking change.
Please review @terrestris/devs.

Thanks for the review!


DDS-60 not setting correctly

With the 1.4 version of code + PCB, the DDS frequency is not being set properly.  That is, the frequency emitted by the DDS-60 is NOT what is displayed on the screen.

Not sure what I changed (if anything), but DDS-60 is now producing approx the correct frequency.


Ensure out-of-memory errors are reported

Problem Statement
When PHP hits the configured memory_limit, a fatal error is thrown. The Laravel framework is configured to handle such fatal errors through register_shutdown_function() and frees some memory to allow further processing of the error (about 32k as of https://github.com/laravel/framework/pull/42646/files). When that reserved memory is exceeded again, the process abruptly stops.
I found that this SDK sometimes fails to report out-of-memory errors, most likely due to excessive memory usage during reporting. In our application, errors such as Allowed memory size of x exceeded make it to Sentry only some amount of times. Other times, the process just crashes abruptly with no indication as to what went wrong.
Solution Brainstorm
I suspect that the breadcrumbs and other information that is already stored in the SDK context leading up to the out-of-memory error influence how much memory is used to report the error. Perhaps the SDK can detect out-of-memory errors and somehow limit the amount of memory it consumes to be well under the

The PHP SDK also keeps a memory buffer (on top of Laravel) and we have tried to make this more reliable already: getsentry/sentry-php#1633 (also ported to 4.x).
I am wondering if both those measures have no effect because Laravel is handling the error and we therefore don't detect it as an OOM event and thus don't take the measure in the PHP SDK to free up our own buffer and perform an additional memory increase.
It's very hard to test and create a definitive test case for this, so many variables 😄
Happy to try and find a more stable solution though. I think the first thing to do is make sure the PHP SDK is aware it is an OOM event and can take it's own measures. If that is not enough we could see if we can limit or drop added event data to make it's capture more reliable.


Tutorials for mmdet models

📓 New Tutorial
We already have the starting point for the tutorials for bbox and for mask. But right now that's just a bunch of code, we need to explain what is happening there

Don't remove
Main issue for examples: #39

already adressed by #691


Issue connecting to Azure OpenAI services

I am facing the below issue when trying to use Azure OpenAI service.
When using the below code I am getting the following error:
`import guidance
llm_azure = guidance.llms.OpenAI(
"gpt-3.5-turbo",
api_type="azure",
api_key="<API_KEY>",
api_base="<BASE_URL>",
api_version="2023-03-15-preview",
caching=False,
)
guidance.llm = llm_azure`
Error:
AttributeError: module 'guidance' has no attribute 'llms'. Did you mean: 'llm'?
But when I checked the repository code and made the following change in the code as below, I am getting the error as mentioned:
`import guidance
gpt = guidance.models.OpenAI(
api_type="azure",
api_version="2023-03-15-preview",
api_key="<API_KEY>",
endpoint="",
model="gpt-3.5-turbo",
)`
Error:
`Traceback (most recent call last):
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/openai/_base_client.py", line 858, in _request
response = self._client.send(request, auth=self.custom_auth, stream=stream)
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/httpx/_client.py", line 901, in send
response = self._send_handling_auth(
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/httpx/_client.py", line 929, in _send_handling_auth
response = self._send_handling_redirects(
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/httpx/_client.py", line 966, in _send_handling_redirects
response = self._send_single_request(request)
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/httpx/_client.py", line 1002, in _send_single_request
response = transport.handle_request(request)
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/httpx/_transports/default.py", line 227, in handle_request
with map_httpcore_exceptions():
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/contextlib.py", line 153, in exit
self.gen.throw(typ, value, traceback)
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/httpx/_transports/default.py", line 83, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.RemoteProtocolError: Server disconnected without sending a response.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
self.run()
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/threading.py", line 953, in run
self._target(*self._args, **self._kwargs)
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/guidance/models/_remote.py", line 99, in _start_generator_stream
for chunk in generator:
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/guidance/models/_openai.py", line 209, in _generator
raise e
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/guidance/models/_openai.py", line 199, in _generator
generator = self.client.chat.completions.create(
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/openai/_utils/_utils.py", line 299, in wrapper
return func(*args, **kwargs)
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/openai/resources/chat/completions.py", line 598, in create
return self._post(
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/openai/_base_client.py", line 1055, in post
return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/openai/_base_client.py", line 834, in request
return self._request(
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/openai/_base_client.py", line 890, in _request
return self._retry_request(
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/openai/_base_client.py", line 925, in _retry_request
return self._request(
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/openai/_base_client.py", line 890, in _request
return self._retry_request(
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/openai/_base_client.py", line 925, in _retry_request
return self._request(
File "/home/shubham.v/mini/envs/ms_guidance/lib/python3.10/site-packages/openai/_base_client.py", line 897, in _request
raise APIConnectionError(request=request) from err
openai.APIConnectionError: Connection error.
`
Please let me know a fix for the same.
The details for the environment are as below:
Python = 3.10.13
guidance==0.1.2

Exact same issue here

looks like need to use :guidance.models.OpenAIChat ,but I got error because api-version can't set to request url param

@jacksonhu  did guidance.models.OpenAIChat work for you ? can you share your working code block. Thanks

@ksingh-scogo try like this :
`
guidance.llm = guidance.models.OpenAIChat(
model="gpt-4",
api_type='azure',
api_key=os.getenv("AZURE_OPENAI_API_KEY"),
api_base=os.getenv("AZURE_OPENAI_ENDPOINT"),
api_version=os.getenv("AZURE_OPENAI_ENDPOINT_API_VERSION"),
deployment_id=os.getenv("AZURE_OPENAI_DEPLOYMENT_NAME")
)
program = guidance("""My favorite flavor is{{gen 'flavor' max_tokens=10 stop="."}}""")
program()
`

@ksingh-scogo my guidance version is 0.1.3

@dfredriksenkbr new guidance version there is no AzureOpenAI class.

@jacksonhu  thanks for you willingness to support on this, but that did not worked either.
Guidance version 0.1.4

This is what i tried (based on your example)

import os
from dotenv import load_dotenv
import guidance
load_dotenv()
guidance.llm = guidance.models.OpenAIChat(
model="gpt-4",
api_type='azure',
api_key=os.getenv("AZURE_OPENAI_API_KEY"),
api_base=os.getenv("AZURE_OPENAI_ENDPOINT"),
api_version=os.getenv("AZURE_OPENAI_ENDPOINT_API_VERSION"),
deployment_id=os.getenv("AZURE_OPENAI_DEPLOYMENT_NAME")
)

program = guidance("""My favorite flavor is{{gen 'flavor' max_tokens=10 stop="."}}""")
program()

This is what i am getting

Traceback (most recent call last):
  File "/Users/ksingh/git/scogo/llm-experiments/ticket-json-generator/ticket-json-generator.py", line 33, in <module>
    program = guidance("""My favorite flavor is{{gen 'flavor' max_tokens=10 stop="."}}""")
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/guidance/__init__.py", line 30, in __call__
    return _decorator(f, stateless=stateless, cache=cache, dedent=dedent, model=model)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/guidance/__init__.py", line 57, in _decorator
    f = strip_multiline_string_indents(f)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/guidance/_utils.py", line 150, in strip_multiline_string_indents
    source = textwrap.dedent(inspect.getsource(f))
                             ^^^^^^^^^^^^^^^^^^^^
  File<EMAIL_ADDRESS>line 1262, in getsource
    lines, lnum = getsourcelines(object)
                  ^^^^^^^^^^^^^^^^^^^^^^
  File<EMAIL_ADDRESS>line 1244, in getsourcelines
    lines, lnum = findsource(object)
                  ^^^^^^^^^^^^^^^^^^
  File<EMAIL_ADDRESS>line 1063, in findsource
    file = getsourcefile(object)
           ^^^^^^^^^^^^^^^^^^^^^
  File<EMAIL_ADDRESS>line 940, in getsourcefile
    filename = getfile(object)
               ^^^^^^^^^^^^^^^
  File<EMAIL_ADDRESS>line 920, in getfile
    raise TypeError('module, class, method, function, traceback, frame, or '
TypeError: module, class, method, function, traceback, frame, or code object was expected, got str

@ksingh-scogo maybe we should use AzureOpenAI. dfredriksenkbr said there is a separate class for AzureOpenAI ， PR: https://github.com/guidance-ai/guidance/pull/468 .  but it is still a open issue


does vvenc support AVX512(AVX3) now?

Hi,
I'm doing some research on coding tools using vvenc1.8.0. And I tried to force AVX512 to be enabled to support my code by #define USE_AVX512, but compilation failed. I'd like to know if version1.8.0 or the latest version supports AVX512 now?
Regards
Environment
OS: Windows11 22621.1992
Compiler: MSVC16.35
CPU: 12700k(only performance cores are used)

No, VVenC does not support AVX512.
There is no support planned. In that sense our roadmap is aligned with Intels roadmasp for their chips in that regards.

Thank for your reply!
This is my first question&message on github.

Welcome to GitHub


[NEW] RE//verse 2025

Name: RE//verse
Website: https://re-verse.io/
Date(s): Febuary 28 & March 1, 2025
Location: Orlando, Florida, USA
Twitter Handle:  @REverseConf
Free: N

Thanks!


any plan to add support for tvOS?

It could be a great idea, but I don't have the time to do that and I think also the author. @kywix  if you want to help us you are very welcome.

actually I had made the change for tvOS and submitted a PR but I guess it got lost. I will try again. Happy to help.

Hi @kywix I can't see your PR. Are you sure?


typescript compatability

I can not use it in my typescipt project.

I had the same problem. Now started using this - https://react-hot-toast.com/

I had the same problem. Now started using this - https://react-hot-toast.com/

@evandromacedo Can you fix this issue pls

It's shame to claim support of Typescript and don't support it actually... 👎🏼


fix(ValueSet-expand): delete null display fields before resp

Fixes #2740

coverage: 94.21%. remained the same when pulling 55c1d30b9623e170942469fd8530d093088d946c on fix-valueset-expand-display-null into a2891411014d52a8b3f13b99190fc0d0c5ab5ec5 on main.


Support Device Auth Flow

Uh. Where is the documentation covering vscode-auth and why it's necessary?
Why does this extension seem to intentionally not support any other OAuth flow that might be more usable than expecting to be able to POST back to a browser or private URL? (Especially when past issues refer to a workaround that allowed PATs?)

I guess the context is here: https://github.com/Microsoft/vscode-pull-request-github/issues/93
It's too bad that GitHub doesn't have manual authorization code support.
I think this extension should, at the very least, support manual tokens and support the beta device auth flow rather than MITMing (whether it has access to them or not) user github tokens.

https://docs.github.com/en/developers/apps/building-oauth-apps/authorizing-oauth-apps#device-flow

Octokit already supports this auth flow as well (but it also supports PATs...).

Wow, what a nightmare, this uses the builtin github auth provider which... doesn't seem great from first glance. Doesn't use octokit, hardcodes web callback auth.
anyway, guess this issue isn't here after all


MacOS Qt5 overlay clean up

This is a set of patches that improves our Qt5.12 backport for MacOs

Done.


[Uploadable] 'uploadablePostFileProcess' event doesn't contain the new generated filename/path.

I'm trying to add some code in a listener listening the uploadablePostFileProcess.
In my listener I want to access the file which has been processed.
    public function uploadablePostFileProcess(UploadablePostFileProcessEventArgs $args)
    {	exit(var_dump($args->getFileInfo()));
        switch($args->getAction()){
			case 'CREATE':

			break;
			case 'UPDATE':

			break;
			case 'DELETE':

			break;
		}
    }

But the infos returned by $args->getFileInfo() don't contain any information on the generated path / filename.
I don't now if it is intentional ?

May be related to #823

May be :
            $evm->dispatchEvent(Events::uploadablePostFileProcess, new UploadablePostFileProcessEventArgs(
                $this,
                $om,
                $config,
                $fileInfo,
                $object,
                $action
            ));

Should be something like :
            $evm->dispatchEvent(Events::uploadablePostFileProcess, new UploadablePostFileProcessEventArgs(
                $this,
                $om,
                $config,
**                $info,**
                $object,
                $action
            ));

you get your entity as $object and there can be an actual file path and necessary information. also there is callback option also you can extend moveFile method to get the $info.. I think there are many options to hook in, I do not want to introduce backward incompatible changes for not good enough reason

OK, I think it will be easy through the entity.
Thank you.


No records in search after import

hi,
I am running scout:import command and it shows it's running successfully and completed. however, I cannot find any data stored in my index. here are my codes,
protected $mapping = [
        'properties' => [
            'name' => ['type' => 'text'],
            'name_bn' => ['type' => 'text'],
            'address' => ['type' => 'text'],
            'address_bn' => ['type' => 'text'],
            'description' => ['type' => 'text'],
            'description_bn' => ['type' => 'text'],
            'tags' => ['type' => 'keyword'],
            'tags_bn' => ['type' => 'keyword'],
            'category' => ['type' => 'text'],
            'category_bn' => ['type' => 'text'],
            'sub_category' => ['type' => 'text'],
            'sub_category_bn' => ['type' => 'text'],
            'avg_rating' => ['type' => 'float'],
            'area_name' => ['type' => 'text'],
            'location' => ['type' => 'geo_point']
        ]
    ];

and
public function toSearchableArray()
    {
        $array = [
            'name' => $this->name,
            'name_bn' => $this->name_bn,
            'address' => $this->address,
            'address_bn' => $this->address_bn,
            'description' => $this->description,
            'description_bn' => $this->description_bn,
            'tags' => $this->tags()->pluck('name')->all(),
            'tags_bn' => $this->tags()->pluck('name_bn')->all(),
            'category' => $this->category()->first()->name,
            'category_bn' => $this->category()->first()->name_bn,
            'sub_category' => $this->subCategory()->first()->name,
            'sub_category_bn' => $this->subCategory()->first()->name_bn,
            'avg_rating' => $this->avg_rating,
            'area_name' => $this->area_name,
            'location' => [$this->latitude, $this->longitude]
        ];

        return $array;
    }

can any one tell me what am I doing wrong here??

Maybe it's related with issue what I have?
I have index UserIndexConfigurator
<?php
namespace App\Searchable;
use ScoutElastic\IndexConfigurator;
use ScoutElastic\Migratable;
class UserIndexConfigurator extends IndexConfigurator
{
    use Migratable;
    protected $name = 'users';
    /**
     * @var array
     */
    protected $settings = [
        //
    ];
}

And index is prefixed with SCOUT_PREFIX=dev_dev_.
And then i tried to seed 100 users. I also didn't have any results, when i tried to check users, but then i noticed, that users where added to dev_dev_users_write index with type dev_dev_users, but when i try to search them, they are searched in index dev_dev_users.
Can someone explain me why sometimes items are postfixed with _write and sometimes not?
alvibd I would recommend you to inspect your query and check if index matches with real document index.
You can check document index with GET request localhost:9200/_search.

Hello @jlstandout ,
While I cannot certainly say yet before checking tomorrow, but I did find my index with the name I had given and something like a prefix would usually mean it will not effect your model::search() method as the prefix should be implicitly handled by the package.
and I am rather new with elastic search. Still trying to figure out everything with trial and error. I am not the appropriate person to answer your question nor do I have the answer. Sorry! and thank you for your helpfulness. I shall not leave your solution unturned :)

Maybe it's related with issue what I have?
I have index UserIndexConfigurator
<?php
namespace App\Searchable;
use ScoutElastic\IndexConfigurator;
use ScoutElastic\Migratable;
class UserIndexConfigurator extends IndexConfigurator
{
    use Migratable;
    protected $name = 'users';
    /**
     * @var array
     */
    protected $settings = [
        //
    ];
}

And index is prefixed with SCOUT_PREFIX=dev_dev_.
And then i tried to seed 100 users. I also didn't have any results, when i tried to check users, but then i noticed, that users where added to dev_dev_users_write index with type dev_dev_users, but when i try to search them, they are searched in index dev_dev_users.
Can someone explain me why sometimes items are postfixed with _write and sometimes not?
alvibd I would recommend you to inspect your query and check if index matches with real document index. My guess is that your documents are under *_write index.
You can check document index with GET request localhost:9200/_search.

did you solved this problem ???

Yes.

I solved my problem. But not the one you are referring to

i have the same problem that my result returns empty all the time but i can see the in an index but with _write prefix i dont know how to fix that any advise you can give me ??

Try restarting your elasticsearch service. “ sudo systemctl restart elasticsearc“

@alvibd i did that but i was not lucky with that . i dont know what and where is the problem !!!


State class is missing

unexpected state class error with 2021.09.0

After update to core-2021.9.5, looks like the following showed up. I guess it is also related to the above:
2021-09-10 09:50:44 WARNING (MainThread) [homeassistant.components.sensor] Entity sensor.easee_equalizer_home_import_energy_cost (<class 'homeassistant.components.energy.sensor.EnergyCostSensor'>) with state_class measurement has set last_reset. Setting last_reset is deprecated and will be unsupported from Home Assistant Core 2021.11. Please update your configuration if state_class is manually configured, otherwise create a bug report at https://github.com/home-assistant/core/issues?q=is%3Aopen+is%3Aissue+label%3A%22integration%3A+energy%22


Inference hangs on LNL iGPU with large input prompts.

Type of issue

I conducted a benchmark on LNL iGPU for Arcee-lite model, which is based on the Qwen2 Architecture, and obtained via LLM distillation techniques. It turns out the model runs perfectly for [6x128], [6x256] configs, but when given large input prompts (in my case [1000x512]), it hangs without any error logs.

Same issue happened also for Supernova-lite model which is based on the Llama 3.1 architecture, except that none of: [6x128], [6x256] or [1000x512] configurations worked.

The model generation step hungs exactly on this line of code:

  output_ids = model.generate(input_ids, do_sample=False, max_new_tokens=out_len, min_new_tokens=out_len, num_beams=num_beams)

For benchmarking, I'm using all-in-one benchmark scripts, and here is my config.yml file:

repo_id:
  - 'arcee-ai/arcee-lite'
  # - 'arcee-ai/Llama-3.1-SuperNova-Lite'test_api now
local_model_hub: 'C:\Users\Intel\.cache\huggingface\hub\models--arcee-ai--arcee-lite\snapshots\c5cb9c38be16b64757f785f0df36dca87f76d5e2'
warm_up: 1 # must set >=2 when run "pipeline_parallel_gpu" test_api
num_trials: 1
num_beams: 1 # default to greedy search
low_bit: 'sym_int4' # default to use 'sym_int4' (i.e. symmetric int4)
batch_size: 1 # default to 1
in_out_pairs:
    # - '6-128'
    # - '6-256'
    - '1000-512'
test_api:
  # - "transformer_int4_fp16_gpu"             # on Intel GPU, transformer-like API, (qtype=int4), (dtype=fp16)
  # - "transformer_int4_fp16_gpu_win"       # on Intel GPU for Windows, transformer-like API, (qtype=int4), (dtype=fp16)
  # - "transformer_int4_gpu"                # on Intel GPU, transformer-like API, (qtype=int4), (dtype=fp32)
  - "transformer_int4_gpu_win"            # on Intel GPU for Windows, transformer-like API, (qtype=int4), (dtype=fp32)
  # - "transformer_int4_loadlowbit_gpu_win" # on Intel GPU for Windows, transformer-like API, (qtype=int4), use load_low_bit API. Please make sure you have used the save.py to save the converted low bit model
  # - "transformer_int4_fp16_loadlowbit_gpu_win" # on Intel GPU for Windows, transformer-like API, (qtype=int4), (dtype=fp16), use load_low_bit API. Please make sure you have used the save.py to save the converted low bit model
  # - "bigdl_fp16_gpu"                      # on Intel GPU, use ipex-llm transformers API, (dtype=fp16), (qtype=fp16)
  # - "optimize_model_gpu"                  # on Intel GPU, can optimize any pytorch models include transformer model
  # - "deepspeed_optimize_model_gpu"        # on Intel GPU, deepspeed autotp inference
  # - "pipeline_parallel_gpu"               # on Intel GPU, pipeline parallel inference
  # - "speculative_gpu"                     # on Intel GPU, inference with self-speculative decoding
  # - "transformer_int4"                    # on Intel CPU, transformer-like API, (qtype=int4)
  # - "native_int4"                         # on Intel CPU
  # - "optimize_model"                      # on Intel CPU, can optimize any pytorch models include transformer model
  # - "pytorch_autocast_bf16"               # on Intel CPU
  # - "transformer_autocast_bf16"           # on Intel CPU
  # - "bigdl_ipex_bf16"                     # on Intel CPU, (qtype=bf16)
  # - "bigdl_ipex_int4"                     # on Intel CPU, (qtype=int4)
  # - "bigdl_ipex_int8"                     # on Intel CPU, (qtype=int8)
  # - "speculative_cpu"                     # on Intel CPU, inference with self-speculative decoding
  # - "deepspeed_transformer_int4_cpu"      # on Intel CPU, deepspeed autotp inference
  # - "transformers_int4_npu_win"           # on Intel NPU for Windows,  transformer-like API, (qtype=int4)
  # - "transformers_int4_loadlowbit_npu_win" # on Intel NPU for Windows, transformer-like API, (qtype=int4), use load_low_bit API. Please make sure you have used the save_npu.py to save the converted low bit model
cpu_embedding: False # whether put embedding to CPU
streaming: False # whether output in streaming way (only available now for gpu win related test_api)
optimize_model: False # whether apply further optimization on NPU (only available now for transformers_int4_npu_win test_api)
use_fp16_torch_dtype: True # whether use fp16 for non-linear layer (only available now for "pipeline_parallel_gpu" test_api)
task: 'continuation' # task can be 'continuation', 'QA' and 'summarize'
transpose_value_cache: True # whether apply transposed v_cache optimization on NPU (only available now for transformers_int4_npu_win test_api)

GPU Driver version
<IP_ADDRESS>37
What operating system are you seeing the problem on?
Windows 11

Hi @aahouzi ,
We recently update ipex-llm for Lunar Lake (LNL) support. You could refer to here regarding how to install ipex-llm for LNL iGPU.
Besides, for all-in-one benchmark, you could also try on test_api transformer_int4_fp16_gpu_win.
Please let us know for any further problems :)

Hi @aahouzi,
We have reproduced this issue on Arcee-lite model, and will update here once we have fixed it :)

Hi @aahouzi,
We have fixed this issue. You could install ipex-llm[xpu_lnl]>=2.2.0b20241014 through:
pip install --pre --upgrade ipex-llm[xpu_lnl] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/lnl/us/

Please let us know for any further problems :)

Thanks @Oscilloscope98, it's working now :)


Add ReminderIs operator

@hudson-ai - take a look, maybe you have some more ideas for tests? generally appears to work.
I suspect that checking intersection of ReminderIs() with some number ranges might be somewhat expensive, but I guess we'll see on real testcases
see https://github.com/guidance-ai/llguidance/pull/79

Not a super helpful comment, but it should be Remainder, not Reminder, no? :)
Orthogonal to that, help me wrap my head around something here...
Clearly, we can keep track of the remainder of the digits that have already been written, and we just say that the next digit is nullable iff said remainder is zero. That feels like a clear and simple and "obviously correct" algorithm.
That being said, I can't quite seem to get here following the definition of derivatives!
Let $R(a, k)$ be the regex matching any string that has a value that is $k \pmod{a}$.
Then $\text{deriv}(R(a,k), d) = \lbrace s \mid d\cdot s \in R(a,k)\rbrace$.
We have that $\text{val}(d\cdot s) \equiv \text{val}(d)\cdot 10^{n} + \text{val}(s)$ where $n = \text{len}(s)$.
This seems to imply that
$$
\text{deriv}(R(a,k), d) = \bigcup_{n ≥ 0} \lbrace s \mid \text{len}(s) = n, s \in R(a,k - \text{val}(d)\cdot 10^{n} \pmod{n})\rbrace.
$$
This is definitely not the desired result.

The logic seems correct, although I want to note that as written, we can't get regexes that match $\lbrace s | \text{val}(s) = r \pmod{d}\rbrace$ for $r\neq0$. This is probably super minor, as we likely don't need this to work for $r\neq0$. But adding this will require one extra piece of book-keeping.
In that vein, I worked out a "proper" proof. Been bugging me.
Let $R(d, r, c)$ be the regex matching any string $s$ such that
$$
\text{val}(s) + 10^{|s|}c \equiv r \pmod{d},.
$$
By the definition of the regex derivative,
$$
\text{deriv}(R(d,r,c), x) = \lbrace s \mid x\cdot s \in R(d,r,c)\rbrace
$$
We have that $x\cdot s \in R(d,r,c) \iff \text{val}(x\cdot s) + 10^{|s|+1}c$. Furthermore, we have that $\text{val}(x\cdot s) = s + 10^{|s|}\text{val}(x)$.
Therefore, $\text{val}(s) + 10^{|s|}\text{val}(x) + 10^{|s+1|}c \equiv r \pmod{d}$.
Rearranging,
$$
\text{val}(s) + 10^{|s|}(10c + \text{val}(x)) \equiv r \pmod{d},,
$$
so
$$
\text{deriv}(R(d,r,c), x) = R(d, r, 10c + \text{val}(x)),.
$$
Finally, observe that $R(d,r,0)$ matches all strings $s$ such that
$$
\text{val}(s) \equiv r \pmod{d},,
$$
as needed.
In terms of an implementation, we just need to say that we're nullable iff r == c.

I also think we can extend this to decimal $d$ with a little extra bookkeeping. Will mull that over (not essential for this PR)


Thoughts on Pagekeeper thumbnails?

I've pushed an update that allows a Phez site operator to enable thumbnails via the Pagekeeper API.
What do you guys think of the look & feel of these thumbs?
I'm not too hot on:

the loading animated gif when they haven't indexed the page yet
they don't crop the thumbnails very well for extra wide or long photos

It'd also be a big undertaking to roll an in-house solution, so I'm not sure what to do next.

I think for the present time they're completely fine.

Sounds good. Closing this issue for now. Maybe down the road we'll implement an in-house solution that pull down remote images and resizes them into better thumbnails.


[Feature] [GSOC] IDE Plugins for editing vela applications

Is your feature request related to a problem? Please describe.

With more and more developers start writing KubeVela (OAM) application YAML file and CUE-based X-Definitions, it is increasingly important to provide some tools to help user make correct configurations. IDE plugin is one way to reach that. We can make VSCode/Jetbrains plugins for formatting and previewing the written applications.
Describe the solution you'd like

The plugin is expected to be able to:

Connect to the remote Kubernetes APIServer (KubeVela Control Plane) in the background and recognize the X-Definitions (ComponentDefinitions, TraitDefinitions, PolicyDefinitions, WorkflowStepDefinitions).
Highlight the type of components, traits, policies & workflowsteps in the application configuration.
Preview the rendering result (dryrun) of the components & traits.
Compare the difference between the current application configuration and the corresponding one on the remote cluster.
Preview the selected clusters by the topology policy.
For ComponentDefinition & TraitDefinition, provide validation for the CUE input and preview for the rendering result.

Describe alternatives you've considered

An alternative choice is to make some standalone development tools like desktop apps. It can be developed with cross-platform build tools like electron/dart.
Additional context

Feel free to discuss what this tool should be look like below. :)

This project is really awesome, and maybe there's a lot of interaction detail to discuss. I think the kernel is Watching some events and then calling a shell to execute kubectl or vela and do some string resolve.
But I'm new to kubevela, the first step is to get familiar with kubevela, then design the UI and interaction, right? could you give me some advice? @Somefive thx:)

@Charlie17Li Hi, glad to hear that. Let's leave this issue for the discussion of the IDE plugins. If you need advices on starting with KubeVela, you can contact me in the DingDing group or Slack channel.
Yes, for the IDE part, I think executing kubectl or vela could be one way to deal with that.


SQL permissions issue when using vagrant setup

followed steps in https://github.com/depesz/explain.depesz.com#vagrant-setup, ended up with  SQL error when posting first plan to local service:
2017-04-13 07:47:05 UTC ERROR:  permission denied for schema plans at character 13
2017-04-13 07:47:05 UTC QUERY:  INSERT INTO plans."part_O" (id, title, plan, is_public, entered_on, is_anonymized, delete_key, added_by) VALUES ($1, $2, $3, $4, no
w(), $5, $6, $7 )
2017-04-13 07:47:05 UTC CONTEXT:  PL/pgSQL function register_plan(text,text,boolean,boolean,text) line 12 at EXECUTE statement
2017-04-13 07:47:05 UTC STATEMENT:  SELECT id, delete_key FROM register_plan('', '"my plan here)"

my environment was as follows:
:~/explain.depesz.com$ git show
commit e289a74ccb0f7477868fc7e448ec46bb58eb07d0

~/explain.depesz.com$ vagrant version
Installed Version: 1.9.1
Latest Version: 1.9.3

~/explain.depesz.com$ uname -a
Linux boxname 4.4.0-72-generic #93-Ubuntu SMP Fri Mar 31 14:07:41 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
~/explain.depesz.com$ lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 16.04.2 LTS
Release:	16.04
Codename:	xenial

Sorry, I have literally zero knowledge about vagrant. It looks that your tables were created by different user than the one that you are using from explain app to connect to the database from. No idea how to change it in vagrant, but  in psql, it's as simple as:
alter table  set owner to <some_user>;
If you can fix vagrant setup - I'll gladly include the patch, otherwise we can wait for @pkorobeinikov to chime in - maybe he knows what's up.

note: i also have no vagrant knowledge, just grep'ed GRANT's in configs.

Thanks a lot. I Assumed you tested it, and it solved the problem for you.


PR for issue 99

Drop sspop and redefine the code points presently defined for it as ssload
Introduce a sspinc instruction that increments ssp by a non-zero unsigned 5-bit immediate scaled by XLEN/8
Change privilege at which ssp CSR can be accessed from URW to SRW

@ingallsj @deepak0414 @kwalker27 @kacouane


compilation failure installing from source on Ubuntu 32 bit

I have Ubuntu (the most recent LTS version), and when compiling from source got an error to the effect that <asm/errno.h> could not be found when running:
./update-fcp.sh && ../facebook-clang-plugin/clang/setup.sh && ./compile-fcp.sh # go have a coffee :)
Sadly, the Screen session in which I ran this (twice) has been closed, and it takes two hours to hit the error, and the script which runs the thing seems to delete the /tmp/clang.XXXXX build directory on failure, so it's expensive for me to get the exact error message. I do, AFAICT, have the build-essentials etc prerequisites installed, though in my case it's linux-libc-dev:i386

Hi @mk270 which version of gcc you have?
As far as I know you need at least gcc 4.7.2. When we tested building from source on Ubuntu LTS we actually installed gcc-4.8 (so it didn't work with default gcc for some reason) an it worked for us then
https://github.com/facebook/infer/blob/master/INSTALL.md

I have, according to gcc --version: gcc (Ubuntu 4.8.2-19ubuntu1) 4.8.2

Thanks for the report, I'll look into it

I managed to reproduce the issue on 32 bit ubuntu precise LTS

Ah good, thanks. I fancied I might be going a bit mad.
My own setup is 32bit fairly vanilla Ubuntu trusty, i.e. another of Ubuntu's LTS releases.

closing as we have upgraded clang many times since this issue was open. Please do reopen if there is still an issue with the latest version of infer.


Move getType() from geometry subclasses to ol.geom.Geometry

To improve the API the function getType() from geometry subclasses  should be "moved" to ol.geom.Geometry. The sublcasses could then override it.
See for example:
ol.geom.Point.getType()
ol.geom.Polygon.getType()

[x ] I have searched GitHub to see if a similar bug or feature request has already been reported.
[x ] If reporting a bug, I have tried with the latest version of OpenLayers (see 'LATEST' on https://openlayers.org/)

Not sure what you mean, because this it the case already. The abstract method is defined in ol.geom.Geometry, and subclasses implement with the correct type, e.g. ol.geom.Point.

Ok, I see. Then this issue is related to the API docs:
See: http://openlayers.org/en/latest/apidoc/ol.geom.Geometry.html
and http://openlayers.org/en/latest/apidoc/ol.geom.Point.html#getType
There you can't see the inheritance.

That's because ol.geom.Geometry does not make #getType() exportable, because it is an abstract method, and the abstract ol.geom.SimpleGeometry class does not implement it. May I ask why knowing about the inheritance would be important here?

Yes, I am using the API docs to implement the typesafe OL Java wrapper gwt-ol3. It is a little bit confusing when looking to the API. Because on most methods you have the info that they are inherited (for example ol.geom.Geometry.html#get). On subclasses of ol.geom.Geometry you don't have the info that method getType() is inherited/extended.

Understood. I think the way we handle inheritance in the docs works for the majority of our users. Would it be ok for you to build a custom documentation for your purpose? All you'd have to do is remove a single line in config/jsdoc/api/conf.json:
--- a/config/jsdoc/api/conf.json
+++ b/config/jsdoc/api/conf.json
@@ -20,8 +20,7 @@
         "../../config/jsdoc/api/plugins/inheritdoc",
         "../../config/jsdoc/api/plugins/typedefs",
         "../../config/jsdoc/api/plugins/events",
-        "../../config/jsdoc/api/plugins/observable",
-        "../../config/jsdoc/api/plugins/api"
+        "../../config/jsdoc/api/plugins/observable"
     ],
     "markdown": {
         "parser": "gfm"

You should only use the generated documentation for resolving inheritance paths, because it will contain everything, even things that are not part of the official OpenLayers API.

Ok, if this is the expected result for the users I don't have any objection. I will not have a problem with that because I can also look into the code ;-)
My intention is to support the official OpenLayers API only.
Thanks!


Ubuntu boost error

crow_all.h:3353: error: ‘boost::asio::ip::tcp::socket’ {aka ‘class boost::asio::basic_stream_socketboost::asio::ip::tcp’} has no member named ‘get_io_service’
main.cpp:1:
crow_all.h: In member function ‘boost::asio::io_service& crow::SocketAdaptor::get_io_service()’:
crow_all.h:3353:28: error: ‘boost::asio::ip::tcp::socket’ {aka ‘class boost::asio::basic_stream_socketboost::asio::ip::tcp’} has no member named ‘get_io_service’
3353 |             return socket_.get_io_service();

Using built-in specs.
COLLECT_GCC=g++
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/9/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none:hsa
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 9.3.0-10ubuntu2' --with-bugurl=file:///usr/share/doc/gcc-9/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --prefix=/usr --with-gcc-major-version-only --program-suffix=-9 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-plugin --enable-default-pie --with-system-zlib --with-target-system-zlib=auto --enable-objc-gc=auto --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none,hsa --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 9.3.0 (Ubuntu 9.3.0-10ubuntu2)

cmake version 3.16.3
CMake suite maintained and supported by Kitware (kitware.com/cmake).
#include "crow_all.h"

##
int main()
{
    crow::SimpleApp app;

    CROW_ROUTE(app, "/")([](){
        return "Hello world";
    });

    app.port(18080).multithreaded().run();
}

https://github.com/ipkn/crow/issues/374#issuecomment-639999932

Hi,
Same on centos8 with crow_all.hpp too,
meson.build
`
project('crow_tuto', 'cpp')
cxx = meson.get_compiler('cpp')
boost = dependency('boost',version : '>=1.73.0', required : false)
if not boost.found()
boost_inc = include_directories('boost/', is_system:true)
boost  = declare_dependency(include_directories : boost_inc)
endif
executable('crow_test', 'crow_test.cpp', dependencies : boost)
`
Regards,
..Francine

@frsauvage This version of crow is incompatible with boost 1.70 or later, you'll need to use a lower version.
If you'd like a version compatible with 1.70 or later, take a look at this.
Note: regarding the meson.build, the boost dependency is absolutely required, crow will not run without boost. I'm not sure how meson works but I thought I should point it out.

Hi @The-EDev, thanks,
That's the point. I didn't notice that incompatibility before.
I should use a lower version,
Regards,

Hi @The-EDev, thanks,
That's the point. I didn't notice that incompatibility before.
I should use a lower version,
Regards,

@frsauvage You can change socket_adaptors.hpp
#if BOOST_VERSION >= 107000
#define GET_IO_SERVICE(s) ((boost::asio::io_context&)(s).get_executor().context())
#else
#define GET_IO_SERVICE(s) ((s)->get_io_service())
#endif

and
	boost::asio::io_service& get_io_service() {
	  return GET_IO_SERVICE(socket_);
	}
......
	boost::asio::io_service& get_io_service() {
	  return GET_IO_SERVICE(raw_socket());
	}

@The-EDev
It worked. Thank you very much!
For clarification, here is what I did in order to get the helloworld example to build and run properly:

$ git clone git@github.com:CrowCpp/Crow.git
$ cd Crow && mkdir build && cd build
$ cmake ..
$ make
$ cd examples/
$ ./helloworld
Open up a new browser window/tab. In the address bar type:  http://<IP_ADDRESS>:18080
Hit ENTER

You should see a plain text html 'Hello World' in the browser window.
Make sure you already have these dependencies:
sudo apt-get install build-essential libboost-dev libboost-system-dev  libasio-dev
sudo apt install libboost-system1.71-dev  # OR WHICHEVER one is the latest version
Just for reference, Igor Mróz was the most recent contributor when I wrote this comment.
Igor Mróz
Nov 8, 2022
Merge pull request https://github.com/CrowCpp/Crow/pull/560 from okaestne/fix-memleaks