Issue when creating custom dataset

Hi everyone,
I wanted to train the model on my own dataset so I followed the instructions as given in the repo. I separated my data into train, test and valid data and fed it into the create_dataset.py given in the repo,
I am using
Python 3.6
OpenCV 3.4.1
I made the required changes to the file to get it working as guided in this thread. and the code starts working. but after creating a few thousand files, it throws the following error. I am using mjsynth dataset.
....
....
Written 689000 / 7224612
Written 690000 / 7224612
Written 691000 / 7224612
Written 692000 / 7224612
Written 693000 / 7224612
error                                     Traceback (most recent call last)
 in ()
----> 1 createDataset('lmdb_data/', df_train_path_list, df_train_label_list, lexiconList=None, checkValid=True)
 in createDataset(outputPath, imagePathList, labelList, lexiconList, checkValid)
23             imageBin = f.read()
24         if checkValid:
---> 25             if not checkImageIsValid(imageBin):
26                 print('%s is not a valid image' % imagePath)
27                 continue
 in checkImageIsValid(imageBin)
3         return False
4     imageBuf = np.fromstring(imageBin, dtype=np.uint8)
----> 5     img = cv2.imdecode(imageBuf, cv2.IMREAD_GRAYSCALE)
6     imgH, imgW = img.shape[0], img.shape[1]
7     if imgH * imgW == 0:
error: OpenCV(3.4.1) /io/opencv/modules/imgcodecs/src/loadsave.cpp:731: error: (-215) !buf.empty() && buf.isContinuous() in function imdecode_
can anyone please tell me what the problem is? I am not able to figure it out.

I have solved this issue.

Hi @Kumara-Kaushik
I don't know how be should put the labels for images , please put your struct dataset both images and labels for training.

hi @zeynali
What exactly is the problem you are facing? Which dataset are you using and what version of python etc. Please give me more details to help you.

@Kumara-Kaushik Hi.I keep encountering the problem "imageName is not a valid image".How do I solve this?Is there any requirement of the image？

hey how you fix the problem? I am using the same dataset msjsynth and having the same problem you just face.
can share the solution?


infer_table_from_schema! panics when that table is in a non-default schema

Using version 0.10.0:
error: proc-macro derive panicked
 --> src/models/mrr_interval.rs:8:1
  |
8 | infer_table_from_schema!("dotenv:PG_URL", "snowflake.mrr_intervals");
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  |
  = help: message: Postgres TableDate has schema
  = note: this error originates in a macro outside of the current crate

The panic comes from:
https://github.com/diesel-rs/diesel/blob/v0.10.0/diesel_infer_schema/src/pg.rs#L131
Which is because (as far as I can see), TableData.schema can only ever be None as set at:
https://github.com/diesel-rs/diesel/blob/v0.10.0/diesel_codegen/src/schema_inference.rs#L58
A brief look at master seems to suggest this might already be fixed, but I'll raise this issue anyway so that the developers are aware of it.
This is being built on a recent nightly, but I'm not sure that's relevant.
ubuntu@snowflake:/vagrant$ rustc --version
rustc 1.17.0-nightly (c49d10207 2017-02-07)

Yes, this has been fixed on master. It's a serious enough bug to warrant a new release. I will cherry-pick it and release a bugfix release with it.

I've released v0.10.1 which includes a fix for this issue. For posterity, this was fixed by https://github.com/diesel-rs/diesel/commit/e0272a4398444666ea7a62b2cf1e6a98003fd17e

Thanks for the quick response!


Tail function may not exist in certain platforms.  Implementing an al…

…ternative in python for those platforms.
Tested on a log file (~60K lines, caffe_output.log).
Tail took about 3ms to return.
Deque took about 17ms.
The performance hit seemed acceptable.

Please limit the first line of your commit messages to 50 characters: https://github.com/blog/926-shiny-new-commit-styles

I like the idea, but can we simply name the function tail and put it in utils.filesystem?

Sure.  Thanks for the suggestion.

Thanks for the platform-specific fix!


Upgrade GitHub Actions checkout@v4 and setup-java@v4

Not sure why dependabot did not react for those GitHub Actions, but they're still v3. :(
Updating them manually.

Thanks!


[BUG] Syntax error in C array declaration and initialization

Describe the bug
I found it in #5177.
def main():
    cdef int arr[4] = [1, 2, 3, 4]

This code doesn't compile:
Error compiling Cython file:
------------------------------------------------------------
...
def main():
    cdef int arr[4] = [1, 2, 3, 4]
                    ^
------------------------------------------------------------

test.pyx:2:20: Syntax error in C variable declaration

But these two do:
def main():
    cdef int arr1[4]
    arr1 = [1, 2, 3, 4]

    cdef int[4] arr2 = [1, 2, 3, 4]

I think it is already known, because it has been mentioned in the documentation:

https://github.com/cython/cython/blob/b2cad768499cf5763251fe757491e9fc24a1f583/docs/src/userguide/language_basics.rst#L124-L129

but I couldn't find the related issue.
Anyway, if it can't be fixed easily, it will be good to document it more clearly.
Code to reproduce the behaviour:
No response
Expected behaviour
No response
Environment
Cython version: both 0.29.32 and 3.0.0a11
Additional context
No response

Just a thought. Should Cython support both syntaxes to declare array?
cdef int arr1[4]   # C style array declaration
cdef int[4] arr1   # Java style array declaration

it seems that both of them generate same C code but the Java style (cdef int[4] arr1) is more consistent because:

Memoryviews are defined in the same way: cdef int [:, :, :] narr_view = narr [1]
As mentioned in the bug report Cython currently supports cdef int[4] arr2 = [1, 2, 3, 4] but not cdef int arr[4] = [1, 2, 3, 4]
Defining fused types uses syntax of TYPE[n]:ctypedef fused my_fused_type:
    int[3]
    float[2]

Hence my proposal is following. Does it make sense to soft-deprecated: use only Java style array definition (cdef int[4] arr1) in Cython Documentation in all places but still support the C style (to keep backward compatibility).
Any thoughts?
[1] https://cython.readthedocs.io/en/latest/src/userguide/memoryviews.html

it seems that both of them generate same C code but the Java style (cdef int[4] arr1) is more consistent
Soft-deprecate C style definition - use only Java style array definition (cdef int[4] arr1) in Cython Documentation in all places but still support the C style (to keep backward compatibility).

Fair enough.
BTW, Java style cdef int[4] a, b is different from C style cdef int a[4], b (whether b is an areay or an int), but the latter seems to have been deprecated for almost 10 years: https://github.com/cython/cython/commit/9e3a2d7ae9fce31bfbba19f39fc882e6ded78462.
However, the documentation said:

https://github.com/cython/cython/blob/d888842ed8efec0d859dc5978900bb08161d7835/docs/src/userguide/language_basics.rst#L89-L91

which will generate warnings:
warning: test.pyx:3:19: Non-trivial type declarators in shared declaration (e.g. mix of pointers and values). Each pointer declaration should be on its own line.
warning: test.pyx:3:25: Non-trivial type declarators in shared declaration (e.g. mix of pointers and values). Each pointer declaration should be on its own line.

IMO it's better to mention it in the documentation.

I'll leave this open for now. I think I'd accept a simple parser change to make the other syntax work. But I suspect it's low priority and may not happen

I was just wondering how would I declare an array of pointers with java style declaration. I stumbled across this while trying to fit some linked lists in an array.
cdef Node *data[4]
data = [NULL, NULL, NULL, NULL]

This is the only way that I can think of initialising data for now.
I was expecting it to be something like this to work:
cdef Node*[4] data = [NULL, NULL, NULL, NULL]

This should work:

cdef Node* data = [NULL, NULL, NULL, NULL]

Doing cdef Node** data = [NULL, NULL, NULL, NULL] works as a replacement thx. It's interesting how using type* var_name in Cython is like type var_name[] in C where u can omit the length if being initialized.

If I understand correctly, "soft-deprecating" something doesn't mean that we will actually deprecate it. "soft-deprecated" only means it's not recommended, but will be still supported without any warnings. So if you really need the C style syntax, you can use it as expected, it's OK.
However, I agree that:
cdef Node*[4] data = [NULL, NULL, NULL, NULL]

can be a useful feature that will improve code consistency.

"soft-deprecated" only means it's not recommended, but will be still supported without any warnings.

Yes. It should be the preferred way and should be used in all examples in documentation.


Different Translation used for showing name in left editor column and flow editor

What are the steps to reproduce?
Having a fresh install of node-red in german.
What happens?
Nodes list their names in the left column in english, in all other aspects (afaik) they are listed in german.
This leads to nodes displaying different names in the left column and the actual flow.
e.g.: Node called "Range" in the library/left column, is called "Bereich" in flow.
What do you expect to happen?
Having the same translation in left row and flow editor.
e.g.: Node called "Bereich" in flow editor and left column.
Please tell us about your environment:
Using the nodered/node-red-docker container as of 2019-06-05.

[x] Node-RED version: 0.20.5
[ ] node.js version:
[ ] npm version:
[x] Platform/OS: Fedora 29/Docker
[x] Browser: Firefox 67.0 (64 Bit)

This is not an issue with the translation itself - the names on the left hand side (node palette) are (hard-)coded in the node itself and not subject of i18n.
btw: we have a #i18n-german channel in the Node-Red Slack Workspace ((node-red.slack.com)
J.


Use X.Y version in docs on v0.7

But for backward, refer previous build as it is, 0.6.0

Looks like I missed the versioning discussion - will sync up with y'all on monday.

We actually didn't have a discussion, it all came up after hours that we didn't think through doc version change. We hacked it in a rush.
DZ

On Jan 17, 2015, at 03:52, Tomaz Muraus<EMAIL_ADDRESS>wrote:
Looks like I missed the versioning discussion - will sync up with y'all on monday.
—
Reply to this email directly or view it on GitHub.


[TabBar] Allow selected tab to be always in the center

When I used the TabBar component to build my application, I found that the selected Tab was not centered.
Steps to Reproduce

Demo
import 'package:flutter/material.dart';
import 'package:flutter/rendering.dart';
import 'package:flutter/services.dart';

void main() => runApp(HomePage());

class HomePage extends StatefulWidget {
  @override
  State<StatefulWidget> createState() => _HomePageState();
}

class _HomePageState extends State<HomePage> with TickerProviderStateMixin {
  TabController? _tabController;

  static List<Widget> _tabs = [
    Tab(text: "subscribe"),
    Tab(text: "movie"),
    Tab(text: "cartoon"),
    Tab(text: "documentary"),
    Tab(text: "NBA"),
    Tab(text: "KPL"),
    Tab(text: "CBA"),
    Tab(text: "TPL"),
    Tab(text: "SVG"),
    Tab(text: "TNG"),
    Tab(text: "communication"),
    Tab(text: "discover"),
    Tab(text: "cartoon"),
  ];

  @override
  void initState() {
    super.initState();

    _tabController =
        TabController(initialIndex: 1, length: _tabs.length, vsync: this);
  }

  @override
  void dispose() {
    _tabController!.dispose();

    _tabController = null;
    super.dispose();
  }

  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      theme: _defaultThemeStyle,
      home: Scaffold(
        appBar: AppBar(
          title: Theme(
            data: _defaultThemeStyle.copyWith(
              highlightColor: Colors.transparent,
              splashColor: Colors.transparent,
            ),
            child: TabBar(
              tabs: _tabs,
              controller: _tabController,
              physics: const BouncingScrollPhysics(),
              indicatorWeight: 0,
              //labelColor: Colors.black,
              indicator: const BoxDecoration(),
              isScrollable: true,
            ),
          ),
        ),
        body: const SizedBox(),
      ),
    );
  }
}

ThemeData _defaultThemeStyle = ThemeData(
  backgroundColor: ColorAttrs.lightBackgroundColor,
  scaffoldBackgroundColor: ColorAttrs.lightBackgroundColor,
  bottomNavigationBarTheme: BottomNavigationBarThemeData(
    backgroundColor: ColorAttrs.lightBackgroundColor,
    selectedItemColor: ColorAttrs.nav_selected_light_color,
    unselectedItemColor: ColorAttrs.nav_unselected_light_color,
    type: BottomNavigationBarType.fixed,
    showSelectedLabels: true,
    showUnselectedLabels: true,
    elevation: 4,
    selectedLabelStyle: TextStyle(
      fontSize: 10,
      fontWeight: FontWeight.w500,
    ),
    unselectedLabelStyle: TextStyle(
      fontSize: 10,
      fontWeight: FontWeight.w500,
    ),
  ),
  tabBarTheme: TabBarTheme(
    unselectedLabelColor: ColorAttrs.tab_unselected_light_color,
    labelColor: ColorAttrs.tab_selected_light_color,
    labelPadding: EdgeInsets.symmetric(horizontal: 9.4),
    labelStyle: TextStyle(
      fontSize: 24,
      fontWeight: FontWeight.w500,
    ),
    unselectedLabelStyle: TextStyle(
      fontSize: 14,
      fontWeight: FontWeight.w500,
    ),
  ),
  appBarTheme: AppBarTheme(
    backgroundColor: ColorAttrs.lightBackgroundColor,
    brightness: Brightness.light,
    elevation: 0.4,
    centerTitle: true,
    titleTextStyle: TextStyle(
      color: Colors.black,
    ),
    systemOverlayStyle: SystemUiOverlayStyle(
      statusBarColor: Colors.transparent,
      statusBarIconBrightness: Brightness.light,
    ),
    textTheme: TextTheme(
      bodyText1: TextAttrs.light_body,
      headline6: TextAttrs.light_headline6,
    ),
  ),
);

class ColorAttrs {
  const ColorAttrs._();
  static const Color lightBackgroundColor = Color(0xFFFEFEFE);
  static const Color darkBackgroundColor = Color(0xFF000000);

  static const tab_selected_light_color = Color(0xFFFE4C01);
  static const tab_unselected_light_color = Color(0xFF848393);
  static const nav_selected_light_color = Color(0xFFFE4C01);
  static const nav_unselected_light_color = Color(0xFF848393);

  static const tab_selected_dark_color = Color(0xFF9396A0);
  static const tab_unselected_dark_color = Color(0xFF56595F);
  static const nav_selected_dark_color = Color(0xFFFE4C01);
  static const nav_unselected_dark_color = Color(0xFF9396A0);
}

class TextAttrs {
  const TextAttrs._();

  static const TextStyle light_body = TextStyle(
    color: Colors.black,
    fontSize: 14.6,
  );

  static const TextStyle light_headline6 = TextStyle(
    color: Colors.black,
    fontSize: 15.8,
  );
}

Run flutter create bug.
Update the files as follows: ...
reproduce the problem
Step 1: Run my demo
Step 2: Select the tab label 'NBA'

Expected results:
The selected Tab 'NBA' should be centered.
Actual results:
The selected Tab 'NBA' is not centered.
Demo Video Show:
https://user-images.githubusercontent.com/16234264/119970558-74525900-bfe2-11eb-81c5-5fe0df584a7b.mp4
Other problems:

I don't want the selected Tab to be vertically centered, How to make it easy to set the top margin only for the selected Tab?
TabBar doesn't provide a ScrollController, How can I control the Tabs position?
I don't want to see the TabBarView swipe left and right when I hit Tab, but it allows me to manually swipe left and right,    How do I do that?

Logs

flutter analyze
Analyzing flutter_new_test...
No issues found! (ran in 1.9s)

flutter doctor -v
[√] Flutter (Channel stable, 2.2.0, on Microsoft Windows [Version 10.0.17763.1817], locale zh-CN)
    • Flutter version 2.2.0 at C:\wuchaochao\flutter\tools\flutter
    • Framework revision b22742018b (13 days ago), 2021-05-14 19:12:57 -0700
    • Engine revision a9d88a4d18
    • Dart version 2.13.0
    • Pub download mirror https://pub.flutter-io.cn
    • Flutter download mirror https://storage.flutter-io.cn

[√] Android toolchain - develop for Android devices (Android SDK version 29.0.2)
    • Android SDK at C:\Users\wuchaochao\AppData\Local\Android\sdk
    • Platform android-30, build-tools 29.0.2
    • Java binary at: C:\wuchaochao\Android\Android Studio\jre\bin\java
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b01)
    • All Android licenses accepted.

[√] Chrome - develop for the web
    • CHROME_EXECUTABLE = C:\Users\wuchaochao\AppData\Local\Chromium\Application\chrome.exe

[√] Android Studio (version 4.1.0)
    • Android Studio at C:\wuchaochao\Android\Android Studio
    • Flutter plugin can be installed from:
       https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
       https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b01)

[√] Connected device (2 available)
    • M6 Note (mobile) • 721QADRR45FUF • android-arm64  • Android 7.1.2 (API 25)
    • Chrome (web)     • chrome        • web-javascript • unknown

• No issues found!

Hi @ModWU
Thanks for filing the issue.
I wasn't able to find an easy solution, this was also asked SO. but received no answer
Instead of a bug, this should be a feature to allow the selected tab to be always in the center

@TahaTesser
The current use of TabBar  is inflexible, This raises other development issues as well!
Other problems:

I don't want the selected Tabto be vertically centered, How to make it easy to set the top margin only for the selected Tab?
TabBar doesn't provide a ScrollController, How can I control the Tabs position?
I don't want to see the TabBarView swipe left and right when I hit Tab, but it allows me to manually swipe left and right, How do I do that?

Any solution?


[Feature] Add Health Risk Assessment Calculator

Description
Assesses an individual's risk factors for common health conditions (e.g., heart disease, diabetes) based on lifestyle habits, family history, it asses the risk level.
Screenshots
No response
Checklist

[X] I have checked the existing issues.
[X] I follow Contributing Guidelines of this project.
[X] I am a GSSOC'24 contributor.
[ ] I am a IWOC'24 contributor.
[ ] I am a JWOC'24 contributor.
[ ] I am a SWOC'24 contributor.

Code of Conduct

[X] I agree to follow this project's "Code of Conduct".

Go ahead @suhanigupta23


Allow pinning hover popovers (datatips)

The Atom editor had a plugin called atom-ide-ui by @facebook which supported pinning popovers that normally only show on hover.

The pinning feature allows viewing code directly next to relevant snippets of documentation.
I propose this feature for inclusion in VSCode. One possible innovation would be to automatically position those popovers on the right hand side or adding a dedicated pane where pinned popovers could be located depending on the user's current cursor position.
Alternatively, if inclusion in VSCode itself is not possible, would it technically be possible to implement this feature as an extension? Any input is appreciated. Thanks!

Very useful for debugging: https://docs.microsoft.com/en-us/visualstudio/debugger/view-data-values-in-data-tips-in-the-code-editor#pin-properties-in-datatips

Hi! I'd be very interested in this feature.
It'd be pretty useful to be able to pin those tooltips for quick reference so they don't disappear, with the possibility of moving them around to place them in a convenient way, and/or resizing them.
This feature is present in Eclipse JDT, I believe I've seen it in the Resharper plugin for Visual Studio, and on JetBrain IDEs if I recall correctly, to give you a few examples.
Actually the tooltips in Eclipse/IDEA let you navigate through references in the same popup (since it's like a tiny browser) but I guess that's way beyond the scope of this request.
In any case, thank you for considering this feature.


Media_player/plex discovery

Hi all,
This version of the plex component has the following features:

Use of native plexapi 1.1.0

Plex clients are fetched from your local PMS instead of plex.tv

Playback controls works
Discovery support through GDM
Configurator support if PMS requires authentication:

Works out of the box if PMS doesn't require local authentication
Configurator will request X-Plex-Token in case local authentication is enabled. (see https://support.plex.tv/hc/en-us/articles/204059436-Finding-your-account-token-X-Plex-Token)

If auth-token changes, configurator will request new token (does require HASS restart as the objects are already loaded)

Known issues:

only supports one plex server
If GDM is disabled, you will manually need to create plex.conf

This is a JSON dict: {"hostname:port": {"token": "23453654756754365"}}

Future improvements:

Support multiple PMS servers
In case of PMS authentication, configurator should let you choose to enter X-Plex-Token or plex.tv user/pass (which can fetch an X-Plex-Token, and store that).

Testing & feedback is highly appreciated!
There appear to be setups with official clients that do not show up in local PMS

This PR depends on a home-assistant-polymer PR that hasn't been merged yet.
If you want to test, make sure your local network does not require authentication, as configurator does not support fields yet.

@adrienbrault and @miniconfig
Are you able to test this? Didn't see any more updates in #519

I'm on a beach at the moment and will not return until Oct 30th, but I will be happy to test it out then.

Oh, i'm jealous! Enjoy the holiday.

working really good .. better then the old version! thank you so much!

Tested it, looks great :+1:

So it seems that discovery does not work for me :-(

Adrien, is your plex server on the same network so it receives multicast?
On Sat, Oct 31, 2015, 10:58 Adrien Brault<EMAIL_ADDRESS>wrote:

So it seems that discovery does not work for me :-(
—
Reply to this email directly or view it on GitHub
https://github.com/balloob/home-assistant/pull/551#issuecomment-152756023
.


Correct a sentence in core-concepts.md

Correct a sentence in core-concepts.md last paragraph.

thanks @ramizqazi !


V3: Include stack traces for napi threadsafe functions

This adds stack traces to error thrown in Napi threadsafe functions
I will use better types when we move to TypeScript
This requires that the Rust JsCallable is paired with the JavaScript JsCallable
const reportError = jsCallable(() => {
  throw new Error('Hello World')
})

I'll come back to this later


Notebook Update Tests with string args

If you haven't already, please read through our contributing guidelines before opening your PR
What is the purpose of this PR?
Closes #781.
How did you implement your changes
Added quotation marks inside the string format of path.
Remaining issues
N/A.

@ngreenwald I set the test_pypi_depoly  to tag IS present. Or should it be on every merge to main instance?


Quote management?

I need to build a specific output:
- title: "May 7th"

That is to say that the key needs to be plain and the value needs to be "double quoted"
If I set up with
YAML.scalarOptions.str.defaultType = 'QUOTE_DOUBLE'
YAML.scalarOptions.str.defaultKeyType = 'PLAIN'

just before YAML.stringify(), the output comes like
- "title": "September 21st"

What options would I use to get the format that I need (my first example)?

Could you verify that you're experiencing this with version 2.0.0-0? defaultKeyType was only added in that version.

Closing as presumably answered.

I apologize that I didn't make it back here.
From what I remember, I found that yarn add added the stable 1.x version, but the most prominent documentation on the website was 2.x. IOW, the defaults went in 2 different directions.
Also if I recall, the redirect to 1.x documentation is a single sentence buried in the 2.0 docs. IOW it was easy to miss if scanning the docs looking for a specific single thing.
My suggestion would be to make that redirect not only more prominent, but it's own section.


release new version (v2.1.0)?

Considerable changes have been made in the main branch since v2.0.0 was tagged (see https://github.com/deepmind/alphafold/compare/v2.0.0..main), one of which is support for running with a reduced database via --preset=reduced_dbs which is very useful.
Are there any plans to tag newer versions of AlphaFold, like v2.1.0?
That would be really helpful, to ensure that AlphaFold installations are not just random commits, but specific "releases".

I second that. The software is getting quite some traction and thus it is important to have a reproducible installation, which can be achieved by proper releases. It is frustrating for users if they want to use the software on a different facility and then they have to fiddle around, simply their installation procedure is git clone in the lack of proper releases.

Strongly agreed. I've been waiting on a new official release since this:
https://github.com/deepmind/alphafold/issues/29#issuecomment-882605365

Sorry for the delay. We just released v2.0.1: https://github.com/deepmind/alphafold/releases/tag/v2.0.1.


Rust implementation?

I was thinking about using the spec document in this repo, along with cribbing some of your code, to make a pure-Rust implementation over at https://github.com/stac-utils/stac-rs. I was curious if ya'll thought it would be more appropriate to build that implementation over here and just depend on stac-rs instead?
Presumably there could be Python bindings into the Rust impl as well, eventually...also guessing @kylebarron has thought about this already :-).

The pure-rust implementation would also convert STAC json to/from Arrow and Parquet? I'd love to see it but I'd imagine that the schema resolution will be a lot of work in Rust. Some of the pyarrow apis make our life a lot easier, and it would be annoying to redo that in Rust. But if you wanted to work on it, I'm of course very supportive

Tight, alright I'll PoC something over at stac-rs and ping you when it's worth looking at. I've played a bit with https://docs.rs/arrow-json/51.0.0/arrow_json/reader/fn.infer_json_schema_from_iterator.html and I think it will mostly work, with some manual tweaks, but it's still early doors.

That won't work directly on the geometry field any time you have multiple geometry types in a single collection. E.g. if you have polygons most of the time but multi polygons over the antimeridian, it'll fail. We handle that by converting to WKB before inferring a schema from the JSON.

 The motivating example (for now) is to use STAC-GeoParquet + DuckDB as an API backend.

If you run into any issues, feel free to ask!

Released: https://github.com/stac-utils/stac-rs/releases/tag/stac-v0.9.0


[WIP] Add OAuth (UAA) manifest

Codecov Report

Merging #68 into master will decrease coverage by 7.43%.
The diff coverage is 1.26%.

@@            Coverage Diff             @@
##           master      #68      +/-   ##
==========================================
- Coverage   43.16%   35.73%   -7.44%
==========================================
  Files          16       17       +1
  Lines         366      445      +79
==========================================
+ Hits          158      159       +1
- Misses        208      286      +78

Impacted Files
Coverage Δ

tpl/gcp/deployments/oauth/oauth.yml.erb
0% <0%> (ø)

lib/kite/render.rb
83.33% <16.66%> (-7.41%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e978f91...d1c8334. Read the comment docs.


avx 256 issue

Hi, I'm facing a crash while running some code (DX11, either NVidia or ATI driver).
I'm mapping a texture, and filling it using SIMD intrinsic _mm256_stream_si256
When this code runs as stand-alone, it's fine (meaning that mapped buffer is at least 32bytes aligned)
When this code runs through Renderdoc "capture executable", the mapped buffer is only 16bytes aligned.
(I can "hack" my code to use AVX128 instructions)
I'm not sure it comes from Renderdoc (I don't know if mapped buffer pointer comes from D3D or from Renderdoc. If it's the case, would it be possible to align it to at least 32bytes boundary please ?

That commit should align any pointers returned from Map() to 32-bytes instead of 16-bytes.
But as far as I'm aware the D3D spec only guarantees 16-byte alignment - see pData here and this D3D10 page which seems to still apply to all feature levels above D3D10 - so you might be relying on undefined behaviour and it might not always be 32-byte aligned, even stand-alone.

Hi Baldur, thanks for your support :)
I tried with the latest nightly version, still the same issue. Does your change align (32bytes) memory also for textures please ? (I assume it does since the class is named "resource")
I don't know if I'm lucky with "stand-alone" alignment. It's fine on all hardware I'm using. (maybe it's undocumented and D3D force alignment as soon as you have an AVX CPU, I don't know)

Oh right! No, if you are mapping textures there will need to be other changes as well, I'll look into that.
Yes if it's working for now then it doesn't really matter, but I wanted to warn you just in case you distribute it somewhere and other people get a crash maybe.

That commit should now ensure texture Map() pointers are coming back 32-byte aligned. If you're still having issues after tonight's nightly, I might need some help to set up a repro case of what you're running into.

Hi Baldur, I've just tried with "current" nightly (e35fc4000dd0c5ac89b4ab85c03657d59d9df577e), and still the same.
It's easy to reproduce, just add an assert in any of your sample code after a call to Map()
	D3D11_MAPPED_SUBRESOURCE	oLockedRect;

call Map()
if	( ( ((u8)oLockedRect.pData) & 31 ) != 0 )
mpo_Toolbox->GetKernel()->FatalErrorS("Unaligned lock");
"asset" should not be triggered launched as stand-alone, and be triggered launched through Renderdoc.
BTW : I wouldn't be surprised (even if it's not stated in the documentation) that ConstantBuffer map returns 256 bytes aligned pointer since it seems to be the minimal alignment to offset ConstantBuffer, and that other resource map returns at least 64 bytes aligned pointer since it matches the size of a cache-line and enables memcpy (prefetch) optimizations for the subsequent driver's operations (and I wouldn't be surprised standard alignment beeing 4KB as it matches page size)

Damn, yes you're right - when I tested before I must have gotten lucky that it ended up being 32-byte aligned, but I can see now why it's still not working.
The problem is I aligned the whole chunk of a buffer creation with all the data. But there's some additional descriptors and things (like D3D11_BUFFER_DESC) serialised before the actual data, so that can mess with the alignment. Internally I only align buffers to 16-bytes which is way back from when that was the minimum to be D3D11 complaint.
I don't want to break capture file backwards compatibility over this, so I'll probably just over-size the buffers and align that way.

OK this should now align internally within a chunk so all the mapped pointers should really now satisfy 32-byte alignment. I ran my test many times now instead of just the once so let me know how it goes with tonight's nightly build :smile:.

There was a bugfix for this that went in today, some serialised data wasn't accounting for the alignment padding which broke Unmap()s. So try with tonight's nightly instead.

Hi Baldur (thanks for your work, I was off this week-end). I've just tried with this version "2dde5ee5, 2015-04-26", and still get 32bytes unaligned pointers for texture locks.
I can (private) share an EXE if it can help you (I will send you an email later today to tell you where you can get it)

That would be useful yes. The texture path is a bit more complicated than the buffer path, since there are a few places where the memory can be allocated (there's some lazy allocation to avoid allocating CPU-side memory for render targets that don't need it).

Strangely I wasn't able to get the unaligned pointers in my tests, but looking back over it I noticed that the alignment calculation was flawed anyway, so it could easily be non-aligned. It would still be good to get your test EXE - if only so that I can incorporate it into my testing for future versions to make sure this doesn't regress.
In retrospect trying to overlay this larger alignment over the top of the existing 16-byte alignment I had has become rather messy. Originally I set that all up since it was all that the D3D11 API requires, but it means everything was very nicely tuned for 16-byte alignment. Perhaps for the next version (after v0.24 which is due Any Day Now™ once I can stabilise this) I will break file compatibility with previous captures and then I can make the internal alignment variable.

Hi Baldur, I sent you a mail (using your first name at your company address)(the one you gave me some monthes ago) a couple of days ago, maybe this email address is not valid anymore ?
can you contact me by mail please so I can give you the link to download my test EXE ?

Oh right, sorry, if the last time we talked was when I was at Crytek then yes that email address is not valid anymore - I left Crytek in August last year. It also means I won't have your mail address to contact you directly. You can resend to my personal email which is the one I use for everything related to renderdoc<EMAIL_ADDRESS>

With 0.26 all buffers in logs should be natively 64-byte aligned, so this bug should now be fixed (if it wasn't before).


Resources documentation

Hi there,
would it be possible to have a short documentation about the different resources managed by the operator? In the installation document we can check the LVMCluster Resource, that it is easy to understand how to use and what it does. But, would it be possible to know a little about LogicalVolumes, LVMVolumeGroupNodeStatus, etc?
many thanks,

@jgato

PRs are yet to be merged, in the meantime you can refer #99, #100 and #101

I believe this PR will provide some clarifications.


Allow multiple services to use the same loadBalancerIP

Is this a bug report or a feature request?:
Feature request
What happened:
If more than one service is specifying the same loadBalancerIP the first will get the address and the runner-ups will stay in <pending>;
> kubectl get svc
NAME           TYPE           CLUSTER-IP     EXTERNAL-IP   PORT(S)                                        AGE
cgen           LoadBalancer   <IP_ADDRESS>   <pending>     5001:32173/TCP                                 5s
ekvm-busybox   LoadBalancer   <IP_ADDRESS>    <IP_ADDRESS>      1023:32719/TCP,1022:31664/TCP,1080:31486/TCP   1m

What you expected to happen:
Since there is no port conflict the services should both be assigned the common VIP address <IP_ADDRESS> in this case.
The same address can be specified as externalIPs in multiple services and there will be no conflict in Kubernetes. The same should be possible for loadBalancerIP.
The reason is that an application built up by many micro-services should still be able to have a single external address for all those services.
To specify a service containing all ports that the application publishes and have a pod re-distributing the traffic to different micro-services will cause an undesirable dependency (and is quite horrible IMHO).
I am not sure if this limitation is in metallb or in Kubernetes itself, so I am sorry if I ask something out of scope for metallb.
An argument against this would be that a user could specify two services with the same loadBalancerIP and port. So perhaps a configuration parameter can be introduced to enable this feature.

/enhancement

This is already supported, starting in 0.6.0 : https://metallb.universe.tf/usage/#ip-address-sharing . You have to add an annotation to the services to allow IP sharing.
It does have some limitations imposed by how the various protocols work, but it's all documented there.


Adding new AWS::Synthetics::Canary resource, per April 23, 2020 update

Implements #1661

Merged with conflict fixed via 84dce03a30ffcfcf7337a41aa591fe3a1478d511. Thanks!


Create CosmosDB Socket.IO adapter

This will eliminte the extra cost of having a Redis cache in addition to a CosmosDB account.
https://github.com/socketio/socket.io-adapter
https://github.com/learnboost/socket.io-redis

Did you guys build this adapter? Care to share?

@tony-gutierrez Unfortunately not. It may still happen down the road, but it would be a while if it did. Sorry to disappoint.


new option to get additional data in result as option.resultExtension

This will help in getting additional data fields such as geohash, which are currently not returned in the result. The required fields can be specified in the options.

@Suhas-Pachore Thanks a lot. That looks like a good middleground between adding many options and a generic callback. Thanks especially for also editing the documentation.

@Suhas-Pachore Thanks a lot. That looks like a good middleground between adding many options and a generic callback. Thanks especially for also editing the documentation.


python function is not accessible via the amplify v2 data/resource.ts file (or it is not clear how)

Environment information
i am following the instructions here but it is not clear how to reference a python function from the data/resource.ts

It deploys the lambda function correctly (although I imagine most cases will also want to specify a custom docker image as well.

Can you provide an example of how to do that?

<EMAIL_ADDRESS>
Describe the bug
no way to surface python function in the UI
Reproduction steps
follow instructions as specified here<EMAIL_ADDRESS>How to use the python function in the data/resource.ts file?

Hey @cookiejest, thank you for reaching out. Support for python function is currently being tracked on https://github.com/aws-amplify/amplify-backend/pull/1602 and refer to the comments providing some additional information.
Transferring the issue to the API repository for further assistance on the lambda as data source.
On the backend.ts you should be able to use backend.data.addLambdaDataSource to add the custom function as a data  source.
Then use create a custom query with a custom handler resolver to use the datasource.
https://docs.amplify.aws/react/build-a-backend/data/custom-business-logic/#step-2---configure-custom-business-logic-handler-code


gob: type elliptic.p256Curve has no exported fields

After adding
gob.Register(elliptic.P256()) to  encoding.go

Im getting error
gob: type elliptic.p256Curve has no exported fields

The same error here

Have you solved this problem?@akhilparakka


Minor bootstrap-less css issues

The blue border on the new Button widget behaves oddly. (You have to take the pointer out of the button to see it).
The default gray color for the new widgets (dropdown, button etc) looks different from before. Should we reproduce the old style used for ipywidgets 5.x?

cc @afshin

@ellisonbg - this seems to stem from code you added, specifically https://github.com/ipython/ipywidgets/commit/1ab64318b0fa9aba3bd7c4d0710417a9278f22b7#diff-e3a114e453e310b722bb71f53a0f4ad4R203. To reproduce the first problem above, construct a button, click it, then hover the mouse on and off the button.


README: update for libicu dependency

Problem
In 83e7e5dbbdab4026bf7ec6c33ec27a5c07ef98b8 dependencies were only updated for Mac users.  Without libicu, postgres 16 build fails.
Summary of changes
Update dependencies on Ubuntu and fedora to include libicu.
Checklist before requesting a review

[ ] I have performed a self-review of my code.
[ ] If it is a core feature, I have added thorough tests.
[ ] Do we need to implement analytics? if so did you add the relevant metrics to the dashboard?
[ ] If this PR requires public announcement, mark it with /release-notes label and add several sentences in this section.

Checklist before merging

[ ] Do not forget to reformat commit message to not include the above checklist

I did not have to install libicu, but it is installed on my system for some reason. Could not find the package in history.log to find when I installed it.

Merged by myself because of hardware issue for @jcsp.


Optimize Vec and other typed vectors

Right now our vectors are all just lists, but especially for Vec we will probably want to use a more efficient conversion, and ensure that we convert to bytes.

Hold on, I think I might have this figured out


JGRP-2811 Support time units parsing for property values

https://issues.redhat.com/browse/JGRP-2811

probe fails: probe.sh MERGE3.min_interval="25s"; I'll fix this

OK, I made some changes and the testsuite passes. Thanks for the contribution, @tristantarrant ! Do you want me to backport this to the 5.3.x branch?

Not strictly necessary. When are you planning on releasing 5.4 ?

5.4 will take some time, I'm working on NAKACK3 and NAKACK4... I'll backport to 5.3.x then, which I'll release in a few weeks

and backported... I have issues logging into JIRA, to add 5.3.8 as fix-release, will retry tomorrow.


install: Add to-existing-root

This is just mild sugar on top of the existing to-filesystem right now.  But, I think we can do more with this later.
Partially addresses https://github.com/containers/bootc/issues/380

LGTM

I think that c9s-dev-integration was a testing farm flake; restarted, let's see.


Use shell=False in subprocess Function Calls

This codemod sets the shell keyword argument to False in subprocess module function calls that have set it to True.
Setting shell=True will execute the provided command through the system shell which can lead to shell injection vulnerabilities.  In most cases using shell=False is sufficient and leads to much safer code.
The changes from this codemod look like this:
 import subprocess
- subprocess.run("echo 'hi'", shell=True)
+ subprocess.run("echo 'hi'", shell=False)

More reading

https://docs.python.org/3/library/subprocess.html#security-considerations
https://en.wikipedia.org/wiki/Code_injection#Shell_injection
https://stackoverflow.com/a/3172488

🧚🤖  Powered by Pixeebot
Feedback | Community | Docs | Codemod ID: pixee:python/subprocess-shell-false

This change was autogenerated from a GitHub app - called Pixeebot. A code-quality GitHub App; like Dependabot, but for source code. Feel free to check it our for more details for how you can install it onto your project's repo for continued code hardening and code security recommendations. 👍

Any chance you've had the time to review these changes?
If you're not interested implementing them at this time, no worries. I can close the PR and follow up with additional changes in the future. Also, this plugin is free for non-commercial open sourced projects, so feel free to give it an install if you want to see the other recommended PRs. (Pixeebot | Automated code fixes. · GitHub Marketplace)
Thanks,
Zach


configurable logger

Would it be ok if I created some logging configuration for pyrra?
My main reason would be to add JSON logging using the following method in go-kit/log:
https://github.com/go-kit/log/blob/c7bf81493e581feca11e11a7672b14be3591ca43/json_logger.go#L15-L21
But it might also be a good idea to allow configuring logging levels:
https://pkg.go.dev/github.com/go-kit/log/level#example-package-Parsed
I'm willing to open a PR to add this functionality if you agree.

Yep, I'm happy to get a PR that enables JSON logging via the gokit logger. :+1:


CRLP Timezone Date filter fix (attempt #3)

Turns out that my fix the other night to the CRLP Filter Rule unit test to address the timezone issue (i.e., what caused all the builds run after 8PM ET to fail) did not actually work. When I retested again last night, the builds (and my local test still failed). After a bunch of research and testing I figured out what the issue is.

The root cause is that the FilterRule is evaluating a DateTime field (CreatedDate) against a date-only string. Basically something like CreatedDate > 2017-06-01. This should be fine, except that Salesforce does not do a good job documenting what timezone values are returned in.
The FilterRule evaluation class uses the compareDates method to do this work (vs. compareDateTimes) because one side of the equation is a date-only.
The method gets the date from the field using valueOf: Date fieldValue = Date.valueOf(record('CreatedDate')). I would expect that to return the Date of the field in "my" (i.e., local) timezone.
That is not the case. Instead, Salesforce returns the date in GMT (note that it should be date, not dateTime). So, if the record was created on "11/1/2018 9PM ET" you would expect the date to be 11/1/18. However, Salesforce actually returns 11/2/18 because 9PM ET is actually 1AM GMT the next day.
To fix this, I added code to the method to first get the DateTime value of the field, then use the .date() method to get the date portion in the local timezone. ((DateTime)record.get('CreatedDate')).date().
What was a little more interesting is that I originally had code similar to this in the method (which was the root cause of the bug I was trying to fix). The issue there was that the code to re-cast the Date as a DateTime field ran on every single compare, whether it was a Date or DateTime field. Apparently, Salesforce is not quite consistent on what it returns based on the type of field.
To get this working in all cases, the key was only doing that recast to a DateTime if the field is actually a DateTime type. Basically, I put this code within an if (rule.fieldType == SoapType.DATETIME) block so it only casts the field to a DateTime if it's actually a DateTime field.

This PR also changes how the compareDateTimes method converts the DateTime string that the CRLP Settings UI creates into a DateTime. The UI adds "T" and "Z" to the dateTime string, which does not work when valueOf() is used to convert the string. It appears that this was never actually tested manually because the conversion would fail.
Critical Changes
Changes
Issues Closed
New Metadata
Deleted Metadata

@jjbennett The tests pass on this branch now, but until it's merged all other builds > 8PM ET are still failing. I think from our conversation earlier this was good, but I didn't want to merge until you've had a chance to give your final approval.


Naming convention

I believe it would be clearer if each project would use civil year convention, i.e po/2021 instead of po/2021-2022 as it would make the repo more "readable" and it's clear enough that 2021 refers to 2021-2022 even if the course happens to go into the next year (for example, 1st semester courses of the 2nd period, so/2021 is still clear what it refers to). Even though 2nd semester classes would appear to be of "different years" it would not cause any conflicts for future people because courses are lectured always 1 year apart and every student will always know that 2022 IAED project refers to the 2021-2022 semester. This might seem kinda picky, let me know!

I also agree having 2021-2022 is quite annoying and unreadable at times.
However, it's explicit what everything is. Having lp/2022, for example, you wouldn't know if it is this year's or last year's (because LP is lectured November - February). You said it's clear enough for people to know what it refers to because of context and commit history (it shows right there the last change, it's probably easy to infer from that), but it might still cause confusion.
I'm in favor of keeping it as is, but I'm open to more opinions.
Other options that came to my head are things like 22-23 or even 2223, but those might be even more confusing.
@RafDevX @Pesteves2002

I really prefer the way it is now tbh.
But if we were to change i think 22-23 would be the way to go.


(youtube-dl) Updated to use au_afterUpdate

You will need to push from your machine new package.

I can't, I'm not the maintainer of the package. that would be

I think all the packages in core should have obligatory maintainer chocolatey besides any other. That way we can share chocolatey api key to selected few.
What do you think @gep13 ?

@majkinetor this package already have a chocolatey as a maintainer, I didn't mention it since I thought it already was obligatory.

@majkinetor @AdmiringWorm yes, all packages in the Core Team Repo require that the chocolatey user be added as a maintainer.
We tend to leave the original package maintainer as a co-maintainer as well, that way they can administer it, if/when required.
In terms of sharing the Chocolatey User API Key, I am still trying to decide the best way to do that.

For now, if a package, outside of the AppVeyor run, needs to be pushed, let me know and I can take care of it.

In terms of sharing the Chocolatey User API Key, I am still trying to decide the best way to do that.

What is wrong with sending it via mail directly to the member ? We can test that out and revoke it if needed.
Alternativelly, more secure way would be to use Gpg and encrypt it via users public key which he must share here or in some public keyring. We could cinst kleopatra for this and for mail there is mailvelope.

That isn't really what I meant.
The chocolatey user is currently the same user that can also push to the official chocolatey package.  With the greatest of respect, neither Rob or I know you well enough to hand over the keys to that package, so I need to talk with @ferventcoder to decide how best to approach this. I think the best idea would be to create a user on chocolatey.org specifically for the core team repo, but again, haven't finished working out the details.

With the greatest of respect, neither Rob or I know you well enough to hand over the keys to that package, so I need to talk with @ferventcoder to decide how best to approach this.

I don't want the keys personally, current method is inefficient is all.
I have better idea.
How about I update appveyor.yml so that it handles special messages. Since everything is set there already it makes sense that AV pushes. This makes it possible for nobody to have a key except those that own the AV project.
So, when you merge and push is required, you can just set commit message to [AU pkg1 pkg2 ... pkgN] and it will force push them. We can also explicitelly set the version something like [AU: pkg1|v1 pkg2|v2 ... ]. So this can be done only by the chocolatey core members who need to merge PR anyway.

Just to clarify, explicit version may be required for situations like this, where version is not changed but you need to repush because of verification failure.

Maybe explicit version is bad idea... I could add new flag to AU, something like NoVersionChange as you typically want to keep existing version (force will use choco fix notation). So that would then become [AU: pkg1! pkg2!] where ! marks this option.


VPN Support

Add support to the various modules to run the torrent client on a manually configured VPN.

[ ] Add options to configure the VPN
[ ] Add options to the ISocket interface to indicate whether VPN works
[ ] Ensure that the 'sender' field works properly for Trackers over VPN'd connections
[ ] Ensure that the connecting to peers works properly over VPN'd connections.

As requested by @robertalpha

Awesome!


[IMPROVEMENT] Correct delete account dialog UI Alignment

Describe the bug

In profile-> Delete Account, the dialog edit text left alignment should be the same as its title left alignment.

I'll start working on this!

@AuraOfDivinity Thank you 😄

Hi @divyanshub024, i looked this part of code and i think it's better to create a custom dialog UI to solve this problem.

Hi @divyanshub024, just send a PR with this fix.  Waiting for review!


omg styling - one last try

If this doesn't work, I'll delete and we'll figure out what's going on in PR 204

Nope, still won't make a page at Styling. So, we'll go back to the original branch and figure out what happened.


[SPARK-41414][CONNECT][PYTHON] Implement date/timestamp functions

What changes were proposed in this pull request?
Implement date/timestamp functions on Spark Connect.
Amond them, functions to_timestamp, from_utc_timestamp, to_utc_timestamp, timestamp_seconds, current_timestamp, date_trunc has inconsistent dtypes issues, that should be resolved in https://issues.apache.org/jira/browse/SPARK-41455.
Why are the changes needed?
For API coverage on Spark Connect.
Does this PR introduce any user-facing change?
Yes. New functions API are supported.
How was this patch tested?
Unit tests.

Can one of the admins verify this patch?

merged into master


Feature/guardians api only

🗃 Github Issue Or Exmplanation for this PR. (What is it supposed to do and Why is needed)
API calls for guardian feature in eos_service.dart
A user can

add / remove guardian permission to / from their account
init guardians
cancel guardians
claim a recovery

A guardian can

recover an account

#180
✅ Checklist

[x] Github issue details are up to date for people to QA.
[x] I have tested all my changes.

🕵♂ Notes for Code Reviewer
Service calls in eos_service
🙈 Screenshots
👯♀ Paired with
@7flash

@n13  You have conflicts in this branch, and while you are fixing those, can you remove these unused imports that are failing your build
info • Unused import: 'package:seeds/providers/services/eos_service.dart' • lib/screens/app/wallet/dashboard.dart:12:8 • unused_import
info • Unused import: 'package:seeds/providers/services/http_service.dart' • lib/screens/app/wallet/dashboard.dart:13:8 • unused_import

Yeah well all that stuff was in there intentionally, to support the showcase code which you can delete after..
but I commented it out now to calm down GH.
Also fixed the conflict, that was unintentional, whoops.


import spinner sass in style tag

This appears to resolve the issue found in issue #198
Successfully created a new build with it.

this works for me too, thanks!


[Bug] Management zones missing the ID

After a export of the management zones the optional ID is missing (https://registry.terraform.io/providers/dynatrace-oss/dynatrace/latest/docs/resources/management_zone)
resource "dynatrace_management_zone" "XX_XXX_XXX" {   name = "WK_Remote_Services"   rules {     type = "SERVICE"     enabled = true     conditions {       process_metadata {         attribute = "PROCESS_GROUP_PREDEFINED_METADATA"         dynamic_key = "KUBERNETES_NAMESPACE" ....
This ID would be needed to assign them in the alerting profile.

The id an attribute that terraform insists on - it's in fact not allowed to be specified explicitly by a provider. Essentially it's the identifier terraform uses within the state to identify a management zone uniquely.
Reading through a couple of currently open issues (like #57) I believe what you're battling with at the moment is the fact, that you would require the ID of certain resources (like the management zone) in order to define others. The culprit behind that is, that the Dynatrace REST API insists on creating new IDs for newly created resources - instead of allowing you to specify the identifier yourself.
That topic haunts me for a while already - and I'm not quite there yet to provide a proper and convenient solution. But it's on my todo list.

Not sure if I'm misunderstanding this issue, but if the management zone and alerting profile are managed by Terraform, can't you just reference it?
resource "dynatrace_alerting_profile" "alerting_profile" {
    display_name = "${local.zone_name} Alerting"
    mz_id = dynatrace_management_zone.zone.id

Thanks @JosephHobbs for chiming in here.
If I'm not mistaken, @ppaltmann is looking for a way to use the exported .tf files without modifications - and that's currently not possible. Using them as a basis for creating something consistent, like you are doing it, definitely works.

@JosephHobbs did you import your ressources after you used the "new" export / legacy download functionality?

unfortunately no.  In my case, I did all my legacy imports before the export download was working.  Long story short, I 'hacked' mine into the Terraform state...

@JosephHobbs we kind of started the same to get Terraform with the import statement in the same state as our env ;)

Hello everyone,
If I'm not mistaken we can close this ticket.
The most recent version of the -export feature allows you to specify also the flag -ref, which automatically downloads dependencies.
In other words, if you export an alerting profile using the -ref option also the management zones it refers to will be downloaded.
Right now you still required to manually import these resources (terraform import) into your local state. Specifying the flag -id when using the export functionality helps here. It generates the ID as a comment at the beginning of all downloaded .tf files.


Port to Xamarin and release on android and ios

This calculator is prob the best and most useable iv seen. I miss having it on windows phone. How easily can we port this to Xamarin forms and release on ios and android?

By running Microsoft's .NET Assembly portability analyzer, you can see the percentage of the current compatibility status. I run it this locally and not much has to be changed to port it to Android and iOS (the assembly compatibility is about 95% on both platforms). So yes. Not much effort has to be put.

This is your friendly Microsoft Issue Bot. I've seen this issue come in and have gone to tell a human about it.

By running Microsoft's .NET Assembly portability analyzer, you can see the percentage of the current compatibility status. I run it this locally and not much has to be changed to port it to Android and iOS (the assembly compatibility is about 95% on both platforms). So yes. Not much effort has to be put.

The main issue is not the assembly compatibility, but Xamarin and .Net Core not supporting C++/CX :(

That's true. You cannot do it with Xamarin. You can use other tools to port it. (So yes. not relevant to this issue)

It's great to hear that you're excited about Calculator! Right now, we are focused on making improvements to Calculator on Windows. You can check out the types of improvements we are looking to make this year on our roadmap. We are going to close this for now, but thank you @pavlkara1 and @rudyhuyn for digging into Xamarin as a possible option here.


[Data Table with Search] Search functionality is broken

Detailed description

Describe in detail the issue you're having.

After upgrading to Carbon v10.37.0, it looks like the search icon gets shifted to the left:

However, regardless of that, the search doesn't appear to be working even before the Carbon upgrade:

Prod link:
https://web-components.carbondesignsystem.com/?path=/story/components-data-table--sortable-with-pagination

Weighing in; Wondering if @jeffchew and the team want to manually bring back the following, that seems to have lost with recent Carbon core updates:

position: relative CSS rule used from our :host(#{$prefix}-table-toolbar-search) selector
flex: auto and transision: flex 175ms $carbon--standard-easing CSS rules used from our :host(#{$prefix}-table-toolbar-search[expanded]) selector
width: 100% CSS rule used from our :host(#{$prefix}-table-toolbar-search[expanded]) .bx--search selector


DJ Introductory Session by SUTD Scratch!

Experience the art of DJing live and song mixing through this workshop!
Abstract
Always wondered what DJs do turning all the knobs and pressing buttons on their seemingly super complicated equipment? Always wondered how DJs mix songs and create mashups that blend so well? Well, look no more and because we can teach you the necessary concepts on how to do those cool things! This event is an obligation-free introductory DJ mixing session for everyone who is interested to experience the art of DJing, regardless of their experience level.
Student Organisation organising this session
SUTD Scratch!
Session intent (what to expect)
Participants will learn about song structures and how DJs use these structures to mix different songs and genres. Participants will also learn various mixing skills such as understanding the equalizer, applying filters and effects as well as transition techniques!
No prior experience is needed to join this workshop as we will be covering everything from the basics! Participants are expected to have a flare for music and eager to learn more about DJing.
Session details
We would like to keep our audience size small so that we can teach our workshop more personally. From prior experience, we find that the maximum audience size that we can cater to is 10 pax, such that there is enough time for each participant to try out the equipment and experience live DJing for themselves.
We will hold the session at the Media Room in the Student Activity Centre. The room itself is Scratch's headquarter/training room, so we will not have an issue with any bookings. We are planning to hold a session on 30 May 2019, from 7 - 9 pm.
We are also planning to hold more sessions for those who are interested but are unable to join on 30 May, since our session size is small. We will update on the timing of these extra sessions soon.
Speakers/Workshop facilitators
The facilitators will be our existing exco club members who have had experience in DJing for school events, private events, bars and even clubs nationwide.
Logistical details
All the equipment required are already inside the Media Room.  We will only need 10 plastic chairs for the participants. We will also require a budget of $50 for drinks and light refreshments, if possible.
Email<EMAIL_ADDRESS>

@Fishbiscuit @tlkh

Thanks, did the assigning for review.
Will take note to include the participant limit of 10, otherwise looks like a pretty exciting workshop!

hello, just to let you know that there's a housing briefing scheduled for 23 May on 1900 onwards, it's a pretty important briefing so freshmores will be expected to attend that too. would you like to change the timing/date? otherwise we could try work out something to key details aren't missed

Noted date of 30 May. Please help to verify details.
https://discover.sutd.dev/events.html#dj-intro

Hi the details are all good! Thank you! btw where can I see the response of the sign up form?

I've actually sent this to your e-mail because you requested to access the document. It should've been sent out in the e-mail, but I'm sorry if I did miss yours out!
Hi we already made one for you and given you access
Sign up link: https://forms.office.com/Pages/ResponsePage.aspx?id=drd2NJDpck-5UGJImDFiPeuYp-gD7fRDoqFCjZlAu1pUMDZOMlAyM0tZUUROUVpaMzRHOElWQkdMVS4u
For organisers: https://forms.office.com/Pages/DesignPage.aspx?fragment=FormId%3Ddrd2NJDpck-5UGJImDFiPeuYp-gD7fRDoqFCjZlAu1pUMDZOMlAyM0tZUUROUVpaMzRHOElWQkdMVS4u%26Token%3D13c9af1e73f0402c8268e6e6edecca44
But I see you've already added your own google form, could you reconcile the reponses from both for your attendees?
Thank you!

Hello! I can't open the second link (the one for organisers). There is currently no response on my own google form :( so I would like to see the responses from the sign up link you created!

The link works on my end, not sure why, You have 6 sign ups. I can just e-mail you the excel sheet tomorrow for final confirmation, will that help?
To get into the link you need to log in to your SUTD account

Hello! I've tried loggin in with my personal SUTD email and Scratch's email but none of them works. Please email me the excel sheet tomorrow! Thank you!

actually can you send me the excel sheet now? i'm afraid those who signed up went for our first session already so i would like to check the participants


Create keen events for auth and sync attempts

Issue created with imdone.io

TODO: Create keen events for auth and sync attempts id:78 +enhancement
plan/plan-imdone-2017-1-30.md:15
@imdone Issue Creator. The developer's task board. imdone.io

TODO: Create keen events for auth and sync attempts. id:78 +enhancement gh:211
plan/plan-imdone-2017-1-30.md:15
@imdone commenter. The developer's task board. imdone.io

TODAY: Create keen events for auth and sync attempts. id:78 +enhancement gh:211
plan/plan-imdone-2017-1-30.md:15
@imdone commenter. The developer's task board. imdone.io

TODO: Create keen events for auth and sync attempts. id:78 +enhancement gh:211
plan/plan-imdone-2017-1-30.md:15
@imdone commenter. The developer's task board. imdone.io

DOING: Create keen events for auth and sync attempts. id:78 +enhancement gh:211
plan/plan-imdone-2017-1-30.md:15
@imdone commenter. The developer's task board. imdone.io

DOING: Create keen events for auth and sync attempts. id:78 +enhancement gh:211 +imdone +work
plan/plan-imdone-2017-1-30.md:15
@imdone commenter. The developer's task board. imdone.io

TODO: Create keen events for auth and sync attempts. id:78 +enhancement gh:211 +imdone +work
plan/plan-imdone-2017-1-30.md:14
@imdone Issue Closer. The developer's task board. imdone.io


Makefile,*: cleanup and refactoring, support reproducible tests locally

Description of the change:
Refactoring and cleanup of the Makefile and hack scripts
Motivation for the change:
The e2e and integration tests are now runnable locally. Overall reduction of complexity and spaghetti.
Checklist
If the pull request includes user-facing changes, extra documentation is required:

[ ] ~Add a new changelog fragment in changelog/fragments (see changelog/fragments/00-template.yaml)~
[x] Add or update relevant sections of the docs website in website/content/en/docs

@camilamacedo86 no rush, but when you get a chance, can you try out each of the make targets in this PR to see if everything works as expected in macOS?

Successful build in my fork is here: https://travis-ci.org/github/joelanford/operator-sdk/builds/735424396

It looks like the way travis does checkouts may cause a recent tag (from a release) that isn't in a PR's branch to not be present, because the commit itself isn't in the branch's history. This wasn't a problem before we started generating samples, but now that we are the git version is incorrect unless your branch has that commit. It's fairly easy to fix (rebase your branch onto the trunk); this will also be fixed if we hard-code versions into the Makefile, as planned.

@camilamacedo86 As I mentioned before, my goal in this PR was to simplify the Makefile and decrease the number of make targets. Samples generation has been folded in under the make generate target

The generate target depends on the build target, which compiles the binaries in the build/ directory. The Makefile now also includes the build/ directory as the first item in $PATH, so it is not necessary to globally install operator-sdk to generate the samples.


Add an option to move focus to console after pressing F5

From<EMAIL_ADDRESS>on 2015-01-18T16:50:49Z
Spyder Version:  2.3.2
Python Version:  2.7.9
Qt Version    :  4.8.6, PyQt4 (API v2) 4.11.3 on Windows
pyflakes >=0.5.0:  0.8.1 (OK)
pep8 >=0.6      :  1.5.7 (OK)
IPython >=0.13  :  2.3.1 (OK)
zmq >=2.1.11    :  14.4.1 (OK)
pygments >=1.6  :  2.0.1 (OK)
pandas >=0.13.1 :  0.15.2 (OK)
sphinx >=0.6.6  :  1.2.3 (OK)
rope >=0.9.2    :  0.10.2 (OK)
matplotlib >=1.0:  1.4.2 (OK)
sympy >=0.7.0   :  0.7.6 (OK)
pylint >=0.25   :  1.4.1 (OK)
What steps will reproduce the problem?
run script like:
from easygui import *
enterbox(msg='Enter something.', title='aaa', default='something')
What is the expected output? What do you see instead?
When running, the easygui window just lost focus, the focus is still on spyder.
Same thing happens with tkinter.
Such problem won't go with IDLE.
Please provide any additional information below
.
Original issue: http://code.google.com/p/spyderlib/issues/detail?id=2123

From<EMAIL_ADDRESS>on 2015-01-18T16:13:02Z
Ok, I maybe figured this out. I must run it in the console by 'runfile' command, then I can get focus on easygui window. But when I edit in the editor and hit the RUN button, the focus will be back to editor.

From<EMAIL_ADDRESS>on 2015-02-08T09:24:12Z
Hey! I am trying to fix this, but being new to the dev process I don't have an idea as to how I should go about this. I think I have located the part of code that I need to modify but can't think of the best way to provide the option. Should I provide a checkbox in Preferences under "Run" tab titled something like "Focus console upon execution"?
Relevant Code: https://bitbucket.org/spyder-ide/spyderlib/src/195ccf4c361604140e1dd8095fec5e12450abf06/spyderlib/plugins/editor.py?at=default#cl-2068

From ccordoba12 on 2015-01-30T13:56:09Z
Summary: Add an option to move focus to console after pressing F5  <span class="oldvalue"> (was: window lose focus for easygui & tkinter at running) </span>
Status: Accepted
Labels: Cat-Editor MS-v2.4

From ccordoba12 on 2015-02-08T11:32:47Z
@-dufferZafar0, yes, I think adding an option to the Run options is the best option. Thanks for looking into this one.

From<EMAIL_ADDRESS>on 2015-02-08T10:15:43Z
Well, I think there might be a misunderstanding. I need the focus on the GUI window, which is created by my own code, but not editor nor console. So I thought there should be three options: focus console, focus editor and focus GUI window created by code.
Hope that's make sense.

From ccordoba12 on 2015-02-08T11:30:36Z
@-wshchzhq, there is no way we can give focus to an external window, sorry. That's the task of the operating system window manager.

From<EMAIL_ADDRESS>on 2015-02-08T11:52:56Z
@-ccordoba12, Yes, thanks for the reply. But is it possible to not add any re-focus command in spyder, so the focusing will move automatically to external window? Because in original IDLE, focus will move to external window (created by code) after execution.

From<EMAIL_ADDRESS>on 2015-02-09T06:40:04Z
@-ccordoba12, While going through the code, I found that there's already a function similar to focusing the console termed as "Interact with the Python console after execution" but it is only enabled when the code is executed in a new dedicated Python Console. Rather than adding an entirely new option, I think it'd be better to just move this option to be available always (instead of only with dedicated consoles.)
I hope I've made myself clear :|

From ccordoba12 on 2015-02-12T08:38:09Z
Yes, I forgot about that one! You're right, I think it's better to unify everything under that option.
Please go ahead and do that :-)


How to get Imbalanced and Balanced datasets

Sorry to be a bother. It's great to see such a simple and effective approach.
I wanted to ask how to obtain the imbalanced and balanced datasets you mentioned in your paper. Being a novice, I'm unsure about how to implement this:
'The test distribution in the balanced evaluation is uniform, i.e., randomly sample 15% of interactions with equal probability w.r.t. items.'
Could you help me out?

I appreciate your interests in our paper and am more than happy to clarify the points you raised.
When we mention “imbalanced” datasets, we are referring to the long-tail distribution. In our Github repository, you can find this as “text_id.txt” file. This name is because this imbalanced test set is similar to training set, i.e. in-distribution.
On the other hand, “balanced” datasets are those in which all items have equal interactions (“text_ood.txt”). In this test scenarios, it is out-of-distribution for the training set due to its uniformity.
To practically implement "randomly sample 15% of interactions with equal probability w.r.t. items",  here are the implementation code
`
import pandas as pd
import operator
import numpy as np
import copy
import random as rd
rd.seed(10)
def helper_load_train(filename):
user_dict_list = {}
item_dict = set()
item_dict_list = {}
trainUser, trainItem = [], []
with open(filename) as f:
    for line in f.readlines():
        line = line.strip('\n').split(' ')
        if len(line) == 0:
            continue
        line = [int(i) for i in line]
        user = line[0]
        items = line[1:]
        item_dict.update(items)
        # LGN
        trainUser.extend([user] * len(items))
        trainItem.extend(items)
        if len(items) == 0:
            continue
        user_dict_list[user] = items

        for item in items:
            if item in item_dict_list.keys():
                item_dict_list[item].append(user)
            else:
                item_dict_list[item] = [user]

return user_dict_list, item_dict, item_dict_list, trainUser, trainItem

def convert(item_dict):
user_list = []
item_list = []
for key, value in item_dict.items():
for user in value:
user_list.append(user)
item_list.append(key)
return user_list, item_list

train_user_list, _, train_item_list, _, _ = helper_load_train("train.txt")
valid_user_list, _, valid_item_list, _, _ = helper_load_train("valid.txt")
test_ood_user_list, _, test_ood_item_list, _, _ = helper_load_train("test_ood.txt")
test_id_user_list, _, test_id_item_list, _ , _ = helper_load_train("test_id.txt")
train_user, train_item = convert(train_item_list)
valid_user, valid_item = convert(valid_item_list)
test_id_user, test_id_item = convert(test_id_item_list)
test_ood_user, test_ood_item = convert(test_ood_item_list)
user_list = train_user + valid_user + test_id_user + test_ood_user
item_list = train_item + valid_item + test_id_item + test_ood_item
df = pd.DataFrame(data = {'user': user_list, 'item': item_list})
total_item_dict = {}
for index, row in df.iterrows():
item = row['item']
user = row['user']
if item in total_item_dict.keys():
total_item_dict[item].append(user)
else:
total_item_dict[item] = [user]
pop_item = {key: len(value) for key, value in total_item_dict.items()}
sorted_pop_item = dict(sorted(pop_item.items(), key=operator.itemgetter(1),reverse=True))
sorted_items = np.array(list(sorted_pop_item.keys()))
each_chunk = int(len(sorted_items)/50)
temp = list(np.linspace(each_chunk,each_chunk*49,49))
temp = [int(x) for x in temp]
chunks = np.split(sorted_items,temp)
def sample_data(chunks = chunks, gamma = 1, n_max = 12, total_item_dict = total_item_dict):
test_dict = {}
left_dict = copy.deepcopy(total_item_dict)

for i in range(50):
    chunk = chunks[i]

    for item in chunk:

        expected_sample = n_max * gamma ** (-(i-1)/(50-1))
        total = len(total_item_dict[item])
        sample_weight = expected_sample / total

        for user in left_dict[item]:

            rad=rd.random()
            # if not sampled, pass
            if rad > sample_weight:
                continue
            # if this is the only one left interaction, pass
            if total == 1:
                continue
            # else add to the dictionary
            if item in test_dict.keys():
                test_dict[item].append(user)
            else:
                test_dict[item] = [user]

            left_dict[item].remove(user)

return test_dict, left_dict

test_dict_1, total_dict_after_1 =
sample_data(chunks = chunks, gamma = 1, n_max = 12, total_item_dict = total_item_dict)
`
"test_dict_1" is the expected result. Change n_max as you want to change the percentage of interactions you want.

Thank you for your response! From the code you provided, I noticed two points:
1.It seems that you used four data files and combined them into a complete dataset.So we can perform similar operations on raw data from other datasets.
2.In fact, you first extracted a balanced dataset and then partitioned the remaining interactions into training, validation, and imbalanced test sets.
Am I correct in understanding your point?  :)


add "modules-late" service

Some modules, when loaded, trigger hotplugging of services that in turn
need some services from the "default" runlevel (like dbus) or which need
local filesystems to be mounted (including the root filesystem (re)mounted
read / write).
This is especially true for devices like NICs or USB modems, but almost
certainly not limited to them.
For example, in current netifrc a wireless NIC handled by wpa_supplicant
module needs dbus service to be started (if wpa_supplicant was built with
dbus support) and these NICs which are handled by dhcpcd need
/var/lib/dhcpcd/ writable (in practice this most often means a need to
have the root filesystem writable).
We order the normal "modules" service before "fsck" service (and so before
remounting the root fs read / write) so filesystems that are on devices
that need some modules loaded can be checked.
There used to be also a problem with usb_modeswitch needing a write access
to the root filesystem when switching mode of an USB modem (see Gentoo bug
565262). It was possible to work it around that time, but since programs
are clearly expecting a root fs being writable it can be reasonably
expected that similar issues will pop up in the future.
To fix this once for all let's introduce a "modules-late" service started
early in the "default" runlevel which can be used to load modules that have
the requirements described above.
This service is implemented via a slight modification of the existing
"modules" script.

Hello,
The issue is not with loading the modules. All modules should be loaded as early as possible. That is why we order the modules and modules-load services the way we do.
The problem is that when services get hotplugged, they get pulled out of the normal boot sequence. So you get situations where services are starting much earlier than they would when they are not hotplugged.
This is off by default because we have no way of knowing how your system is configured. You are discussing the root file system, but /var can also come into play, and if you are using /var on a separate file system, is it a local file system, or is it a network filesystem? We don't know so we don't try to set up hotplugging services by default.
You are saying that the root filesystem being r/w would solve a lot of this, but that's not really the case. Remember that /var can be on its own file system as well, so we would have to check for that, and in theory /var can be a local filesystem or even a network file system.
Also, since the services you are hotplugging are being pulled out of the default runlevel to begin with, this modules-late service wouldn't be the answer.
The answer would be to add the appropriate rc_net_if_need="foo bar bas" lines to /etc/conf.d/net if you are doing this to make sure the appropriate services are run.
I will warn you though, that hotplugging services and sorting out what should run when will be messy; this is why hotplugging services is off by default.

The problem is that when services get hotplugged, they get pulled out of the normal boot sequence.
So you get situations where services are starting much earlier than they would when they are not
hotplugged.

Yes, that's the problem.
Some services should start only when the "default" runlevel is reached, but due to hotplugging are started when the "boot" runlevel is still running.
That's why this pull request introduces a "modules-late" service that is supposed to be in the "default"
runlevel.
Modules loaded by this service can then safely cause hotplugging of services from the "default"
runlevel.

You are discussing the root file system, but /var can also come into play, and if you are using /var
on a separate file system, is it a local file system, or is it a network filesystem?

This (root file system) was used only as an example, as you said the problem could happen also when some other file system (that is not mounted yet or not mounted read / write yet) is needed by some hotplugged service triggered by a module loaded by the "modules" service.

Also, since the services you are hotplugging are being pulled out of the default runlevel to begin with,
this modules-late service wouldn't be the answer.

This "modules-late" service is supposed to be in the "default" runlevel so it is fine if it causes some
services from this runlevel to start.

I will warn you though, that hotplugging services and sorting out what should run when will be messy;
this is why hotplugging services is off by default.

All right, but hotplugging is needed for things like USB network cards that can be plugged in at any time (or alternatively could remain plugged in all the time during a system startup).
What I would like to underline is that this is a second time such problem occurred (previously there
was a problem with USB modems and usb_modeswitch, now with WiFi NICs and wpa_supplicant / dhcpcd) which is solved by introducing this service (I have tested this, naturally).
As I wrote in the description of this pull request, it can be reasonably expected that similar issues will pop up in the future, again.

Some modules, when loaded, trigger hotplugging of services

I am not aware of any kernel modules that require services.
Do you mean devices that depend on a certain module ALSO need services running to be used succesfully ?
This sounds like something that could be solved much easier with a custom (e)udev rule.
http://www.reactivated.net/writing_udev_rules.html , check the advanced topics .

I am not aware of any kernel modules that require services.

Examples: USB network cards, USB modems, network cards that can be either present or not present during particular system startup in general...

This sounds like something that could be solved much easier with a custom (e)udev rule

That's exactly how network interface service hotplugging is currently triggered (via udev) - see
/lib/udev/rules.d/90-network.rules.
This problem is not dependent on what exactly triggers the hotplugging, only that it can be triggered
when a module loads.

It is also worth noting that even with service hotplugging disabled this problem will still occur if a udev
rule triggered by loading a kernel module needs something like root file system mounted read / write
(or more generally, a completed "boot" runlevel) - in fact that's exactly what happened previously with usb_modeswitch.

I have  a lot of expereince with IT troubleshooting, hardeware/software, cdesktop / servers and there's one rule i try to stick to always : treat the root cause , not the symptoms .
module already loaded is not enough to use device effectively is  a symptom .
The root cause : insertion of a device when the system doesn't have everything in place needed.
Solve the root cause by triggering something on device insertion that makes sure everything that's needed is started.

Solve the root cause by triggering something on device insertion that makes sure everything that's
needed is started.

You get a circular dependency this way.
From this PR description:

We order the normal "modules" service before "fsck" service (and so before
remounting the root fs read / write) so filesystems that are on devices
that need some modules loaded can be checked.

The "root" service needs to be started after "fsck",
the "fsck" service needs to be started after "modules".
But due to issues described in this PR the "modules" service needs to be started after "root".
This PR solves this circular dependency by splitting the "modules" service into two parts:

The first one which is needed by the "fsck" service (the old "modules" service),
The second one which needs the "root" service (the new "modules-late" service).

You claim that some modules need to be started after "root" , but i think that's due to a flawed analysis.
Let's see if i can help with the problem analysis.
First let's get a clear picture of the problem.
examples you gave :

wireless  card needs wpa_supplicant, wpa_supplicant needs dbus service
usb modem needs write access to /var (probably needs localmount service for that )

There are (atleast) 2 ways to have openrc start services on demand :

use of rc_hotplug variable in rc.conf
triggered by an external program like udev (using rc-service )

What triggers the problem

external program
device insertion detected by kernel/udev
both
something else  ?

wireless card needs wpa_supplicant, wpa_supplicant needs dbus service

Also dhcpd needs /var/lib/dhcpcd/ writable (provided by "root" or "localmount" service) both for wireless and wired NICs as long as they use dhcpd for their configuration.

usb modem needs write access to /var (probably needs localmount service for that )

usb_modeswitch used to need write access to /tmp (this has been worked around for now, however an
underlying problem remains).

What triggers the problem

Usually it is triggered by a module being loaded by "modules" service on boot but you can assume that if you plug in a device in wrong moment (when the boot runlevel is still being started) it can happen then via a module loaded on kernel request, too.
Generally, what triggers it is a module load which then triggers a udev event which triggers some application (directly or via some hotplugged service) which needs the things described above.

As the netifrc maintainer, I would like to bring a further view to the table. Because even the modules-late proposal is problematic when a given module is built into the kernel. It's also not limited to networking.
What we know:

The system is in the boot or sysinit runlevel.
udev is running.
The module gets loaded or is already built into the kernel.
The kernel generates an event for the device appearing.
udev gets the event.
udev fires a hotplug script fires for the event, per some rules:

25-gpsd.rules
70-spice-webdavd.rules
90-network.rules
99-pcscd-hotplug
99-space-navigator.rules
others...

The hotplug script starts or tries to start a service.
The service is meant for usage during the default runlevel, and causes many other services to start because it's too early.

The modules-load proposal tries to defer the problem, and only load the module when we are in the default runlevel. This won't work if the kernel code was built-in instead of a module, or already loaded by the initramfs.
I think that OpenRC should capture the start event, and delay starting the service until a later runlevel.

Thanks for your input Robin.

This won't work if the kernel code was built-in instead of a module, or already loaded by the
initramfs.

I think these cases are a parallel, but a bit different problem, since they are handled by coldplugging
as OpenRC isn't running yet when these devices are instantiated.
Some coldplugging could be deferred, too.

I think that OpenRC should capture the start event, and delay starting the service until a later
runlevel.

I agree that this would be the best solution to this issue, as long as udev events can be delayed, too
(since they can launch programs like usb_modeswitch).
However, since I don't know OpenRC internals I don't know how big a change is needed to implement
such functionality.
Since the problem is occurring right now if that solution will only be available at an unspecified future time then it would be best to have for now at least something that works.

Rebased this pull request onto current master.
It is worth noting that I have OpenRC with this change deployed for few months already on few
machines without any issues.
Also, this is a backward-compatible change: nothing changes for existing OpenRC setups, unless
a user specifically starts to make use of new functionalities added by it.

Rebased this pull request onto current master.

Let's revive discussion here a bit.
To be honest, I've never set RC_HOTPLUG to any value in OpenRC, so I do not see the value of hotplugging services.
Given how problematic hotplugging services is as discussed in this mr, I think I would rather go the opposite direction and not allow it.
Since it isn't on by default in the first place, are there a number of people using it? Would this feature be missed?
Let me know what you think.

Hotplugging is needed for devices on hot-pluggable buses like USB or even PCIe (ExpressCard or virtualization) since they can show up at any time, and then the relevant service needs to be started (network, pcsc-lite, usbmuxd, ...).
I am using this functionality to have reliable wireless and 3G modem support at boot for more than 3 years now.
Before that, I was hitting race conditions with respect to the services in the "boot" runlevel.
Rebased this pull request onto current master.

I'm just brain-storming, but I wonder if the better answer would be to make sure the hotplugged services don't start until after the boot runlevel is completed?

Not only hotplugged services would need to be delayed until the "boot" runlevel completes, but udev events too since some of them need root fs mounted read / write (for example these that call usb_modeswitch).
But then there is a problem that some of these udev events might be needed for the "boot" runlevel services.
For example, events configuring block devices (and their handlers) may be needed for the "localmount" service.
These udev events would need to be split into instant and delayed ones.
In the end it basically would be the same solution as when splitting the "modules" service (which is what this pull request does).
Only it would probably be harder to configure for an user, since udev events aren't normally user-visible. Unlike module names.

We'd need to consider adding the concept of delayed dependency so when we are made aware of an event and the service that would trigger is in another runlevel not yet reached its activation would be scheduled once you get in that runlevel.
Would be nice to add the whole machinery so you can
rc-update add-hotplugged foo runlevel
rc-update del-hotplugged foo runlevel

I guess would have the simplest user-experience

As I wrote in my previous message, delaying just OpenRC services would not solve the udev event part.

If the udev part depends on a specific system state that depends on an openrc service in general, it would be good to make so it works correctly by having udev trigger openrc and having openrc make sure the required services are available before.
Alternatively I would push your approach further and have the modules initscript behave like netifrc. This way the user would a good way to load groups of modules with a good amount of granularity.

I'm still working on wrapping my head around this; I am trying to understand how other init systems handle it.
Here is what I think I know so far.
Kernel modules can be loaded at several points during the boot sequence:

they can be built in
they can be loaded from an initramfs
they can be loaded by udev
the modules service can load them

No matter when they are loaded in the sequence, they trigger events, which cause udev rules to be run, and these rules can do things that are outside our control and need access to things that may not be available during early boot.
An I correct so far?

@maciejsszmigiero  I have another question specifically for you.
I'm not sure it matters, but please bear with me. In /etc/rc.conf, do you have RC_HOTPLUG set? If so, what is it set to?
Thanks much.

If the udev part depends on a specific system state that depends on an openrc service in general, it would be good to make so it works correctly by having udev trigger openrc and having openrc make sure the required services are available before.

The problem is that some udev events are needed also for the services in the "boot" runlevel.
For example, events configuring block devices (and their handlers) may be needed for the "localmount" service.
So, these udev events would need to be split into instant and delayed ones.
In the end it basically would be the same solution as when splitting the "modules" service.

No matter when they are loaded in the sequence, they trigger events, which cause udev rules to be run, and these rules can do things that are outside our control and need access to things that may not be available during early boot.
An I correct so far?

Yes.
A small footnote here: please note that situation for the modules that are built-in into the kernel (and, to some extent, these loaded by initramfs, too) is different: their events are processed as "coldplug events" by the "udev-trigger" service when this service starts.
While the udev events generated by the modules loaded by the "modules" service are processed directly when they get loaded (well, more or less so, technically the event processing is asynchronous).

In /etc/rc.conf, do you have RC_HOTPLUG set? If so, what is it set to?

I have it set to allow hotplugging of all services:

rc_hotplug="*"

Rebased this pull request onto current master.
Since this patch solves a real issue (that I explained in many comments here over the last 4+ years) I would like to have it finally merged.
Thanks.


Make sidebar (the directive) full-width on mobile

https://github.com/pradyunsg/lutra/commit/44bf8d980abfe2c14ee43511a55f1b7dfcea3272


Convert existing messages to new DB schema

Convert the existing messages to the new database format and add a flag that marks these messages as converted.
We will later use this flag to re-download those messages (see #577).

Nice job!


Error "trust_remote_code=True"

lm_eval --model_args pretrained=/data/hf_model/$model,dtype="float16"
--tasks wsc,winogrande
--batch_size 1
--trust_remote_code
ValueError: The repository for winogrande contains custom code which must be executed to correctly load the dataset. You can inspect the repository content at https://hf.co/datasets/winogrande.
Please pass the argument trust_remote_code=True to allow custom code to be run.
what should i do?

How did you resolve this issue?

I would also like to know

@lyx-hush @TommyClemenzaChen  @erick648  Try this:
export HF_DATASETS_TRUST_REMOTE_CODE=1


Max doesn't start under Ubuntu 16.04

Hi Shawn,
today I installed your maxapp_kinux_installer. Everything was fine and I found the icon in the dash. But when I start Max Home, the icon disapear after a couple of seconds and nothing else happens.
It is a new Ubuntu installation with the 16.04.04 image.
Any ideas??
Regards
Ilonka

Check if java is installed
java -version
not installed, then
sudo apt install default-jre


Add action summary information. (#254)

I'm submitting a

[ ] bug fix
[ *] feature
[ ] documentation addition

What is the current behaviour?
Even run  -vv (tracing mode), didn't provide action key information.
For example CopyFile, can't figure out about source and destination.
current output look like,
TRACE load_config{args=GlobalArgs { manifest_directory: None, no_color: false, verbose: 2, command: Apply(Apply { manifests: [], dry_run: false, label: None }) }}:load_config: No Comtrya.yaml found in current working directory
TRACE load_config{args=GlobalArgs { manifest_directory: None, no_color: false, verbose: 2, command: Apply(Apply { manifests: [], dry_run: false, label: None }) }}:load_config: No Comtrya.yaml found in users config directory
TRACE build_contexts: context="user" key="id" value="1000"
...
TRACE build_contexts: context="env" key="MANAGERPID" value="116167"
TRACE execute: manifests=""
...
TRACE execute: Add dynamic constant 'user' -> #{"config_dir": "/home/shawn/.config", "data_dir": "/home/shawn/.local/share", "data_local_dir": "/home/shawn/.local/share", "document_dir": "/home/shawn/Documents", "home_dir": "/home/shawn", "id": "1000", "name": "Shawn Wang", "username": "shawn"}
TRACE execute: Add dynamic constant 'variables' -> #{}
...
TRACE execute:{manifest="sops"}:{action=file.copy}: Add dynamic constant 'user' -> #{"config_dir": "/home/shawn/.config", "data_dir": "/home/shawn/.local/share", "data_local_dir": "/home/shawn/.local/share", "document_dir": "/home/shawn/Documents", "home_dir": "/home/shawn", "id": "1000", "name": "Shawn Wang", "username": "shawn"}
TRACE execute:{manifest="sops"}:{action=file.copy}: Add dynamic constant 'variables' -> #{}
 INFO execute:{manifest="sops"}: Completed

What is the expected behavior?
╰─❯ /home/shawn/comtrya/target/debug/comtrya   apply
 INFO execute:{manifest="sops"}:{action=file.copy}: copy file from x1234 to y
 INFO execute:{manifest="sops"}: Completed
╰─❯ /home/shawn/comtrya/target/debug/comtrya   apply --dry-run
 INFO execute:{manifest="sops"}:{action=file.copy}: copy file from x1234 to y

Please tell us about your environment:
Version (comtrya --version): comtrya 0.8.8
Operating system: linux

I add a default trait method, but if we think this is a good direction.
Maybe remove default trait method to force all action make a clear summarize would be better.
pub trait Action {
    fn summarize(&self) -> String {
 +       warn!(
 +           "not found action summarize: {}",
 +           std::any::type_name_of_val(self)
 +       );
 +       format!("{:?}", std::any::type_name_of_val(self))
    }
    fn plan(&self, manifest: &Manifest, context: &Contexts) -> anyhow::Result<Vec<Step>>;
}

Should this be called after a plan has co firmed we want to run? Rather than printing summaries of plans we don't need to action?

I'm not sure where is the good place to call it.
Just thought the original information is too limit.

@rawkode Thanks, I moved it to line 254 ish. I can't find line 324 ish. Is this what you mean?

Oops. I meant 234's ish, but where you have put it is fine.
Happy to merge

Avoid to use std::any::type_name_of_val.
Here is the new output with default summarize.
home/shawn/comtrya/target/debug/comtrya -v  apply
 INFO execute:{manifest="sops"}:{action=file.copy}: copy file from x1234 to /tmp/y
 WARN execute:{manifest="sops"}:{action=file.remove}: need to define action summarize
 INFO execute:{manifest="sops"}:{action=file.remove}: not found action summarize
 INFO execute:{manifest="sops"}: Completed


bucket: document buckets are valid only during the transaction

Issue #313
Might be a bit heavy handed, but it does the job.

Yeah, that's probably a good thing to add to the doc. :+1:

Thanks. Maybe close the related issue (I cannot)?

Ah, yeah, np. :)


Add Authorization to Control Plane Apis

User story
As an Admin, I want to be able to call Rbac CRUD apis so that I can add identity providers, roles and role memberships.
Acceptance criteria

When I do [call Rbac CRUD Apis as an Admin], then [I am able to add roles/role memberships/identity providers].

Moving work item tracking to Azure DevOps.


update notebook for up and odisha

Please do cellId and roiId changes to json files under data/ folder.

there are unwanted changes , so closing the PR

okay..
On Mon, Oct 4, 2021 at 12:42 PM Dileep Gadiraju @.***>
wrote:

there are unwanted changes , so closing the PR
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/project-anuvaad/Project-Saral/pull/20#issuecomment-933207614,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AVO2X55NWP27EU53I7ZC5B3UFFHU3ANCNFSM5FEXTHOA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.